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ABSTRACT 

The problems of personnel appraisal are many in any organi- 
zation. Appraisal systems have frequently been studied; recom- 
mendations almost invariably call for the replacement of the 
appraisal report form. However, this analysis of Marine Corps 
officer appraisal is restricted to use of the present report 
format and seeks means for improving officer evaluation within 
that constraint. 

The study traces some recent history of reporting systems 
of the military, Marine Corps and otherwise. It investigates 
the rating scale, details the reporting scheme and considers 
the problematical results produced by rating officers. The 
current use and evaluation of the fitness report is outlined 
briefly and the application of the computer in standard-score 
evaluation of fitness reports is presented. The need for, and 
a means of, feedback to the rater is discussed. 

Essentially, the conclusions of this report could represent 
a first-phase, no-risk endeavor toward better use of the current 


rating system. 
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CHAPTER | 
INTRODUCTION: THE PROBLEM AREA 
'The moving finger writes; 
And having writ, moves on; 
Nor all your piety nor wit 
Shall lure it back to cancel half a line 


Nor all your tears wash out a word of 
i ae 


...Omar Khayyam 


A Statement 

Few topics have been so favored by attention as has person- 
nel performance evaluation. If a reader does not confront, on 
the one hand, almost rampant treatments of the subject by the 
civiltan community |, he may witness, on the other hand, fre- 
quent effort to evaluate military personnel appraisal in his 
favorite military journals. 

The appraisal program of no branch of service has escaped 
criticism, even within very recent months. - General David W. 
Hiester, USA, publishing in Army stated lucidly: ''Perhaps we 
(the U. S. Army) should take a fresh approach to see if we can 
significantly improve the validity of our reports as well as 


2 


facilitate their administration.'' General William C. Hall, 


USA, has said in the same publication: 


Something must be done before the current (efficiency 
reporting) form becomes useless because of inflation. 

A different one...should be devised. ...The only other 
solution | can think of is a moratorium on ratings. 
Limit reports to a single descriptive paragraph. A few 
years of this will create a demand for a rating system. 


see, as example, J. P. Guilford, Psychometric Methods (New 
York: McGraw-Hill Book Company, Inc., 1954) which contains some 
650 references for this and related subjects. 


2navid W. Hiester, ''The Case for Level Raters.'' Army, XV 
(December, 1964), 40. 


3General William C. Hall, ''The Folly of Inflated Ratings,'' 
Army, XIII (April, 1963), 70. 
l 





It is stated in U. S. Naval Institute Proceedings, ina 
moment of obvious literary temperance by its authors: ''That 
our (the services!) present system (of appraisal) apparently 
has functioned adequately iS more a testimony to the quality 
of our officer corps than to the reporting yecentin Later, 
warming to their subject, the authors made this point: 


...If because of the increasingly technical com- 
plexity of the military environment, reporting 
officers are becoming less able to evaluate per- 
formance accurately; and if ''formology'' (refer- 

ing to the reporting format) is, at best, a mutable 
Science, where, then does this find us? It finds 

us exactly where we are now, and where we have been 
subsequent to World War I[!--in a deplorable circle. 


And probably one of the most outspoken reviews of the dilemma 


iS to be found in Armed Forces Management which, among other 


things, editorial ized: 


...we won't bother here to emasculate in great 
detail the silliness that an officer doesn't 
know why, at promotion time, he didn't make it; 
nor, at the outset, whether he was even in the 
running. It's apparently fruitless to note as 
well that he has no meaSuring point against 
which to gauge how well he has performed. The 
record he stands on is not the result of whether 
he won the ball game but of how well somebody 
thinks he played...thus, we find frequent 
charades where an Air Force officer, used to 

One promotion system, will evaluate the perfor- 
mance Of an Army colonel, being judged by 
another system. That, in turn will be endorsed 
by a Navy captain familiar with a third routine-- 
and it will all be forwarded by a civilian me 
has little familiarity with any of the three. 


Major Harold K. Jones, Captain James L. Keating, and 
Lieutenant Commander George Positch, ''Officer Appraisal in the 


Armed Forces,'' U. S. Naval Institute Proceedings, XCI (April, 
1965), 76. 





Sida. bn 77 


Gc. W. Borklund, ''Wno Gets Promoted in this Zoo?!', Armed 
Forces Management, XI (May, 1965), 11. 
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Marines, it is to be noted, can also select from many such 
remarks in their own publications. One example said 

...selection boards have had their hands full 

in trying to pick the cream of the MarCor crop 

for promotion because the majority of reports 

are flowery but give little significant infor- 


mation as to the officer's_particular ability 
and practical application. 


Earlier, Major General J. P. Berkeley, USMC, then Deputy 
Chief of Staff of the Marine Corps, Personnel, published while 
answering openly a query from a non-commissioned Marine con- 
cerning failure of selection to the next higher grade: 

...Our fitness report system is lousy...the 

Board (selection) gets little help from fit- 

ness reports...Since a Board is composed of 

human beings we must admit they make mistakes 

now and then. However, over the years our 


experience has been that they,bat about 90% 
and that is pretty damn good. 


some History 

The evidence seems clearly unfavorable to the several 
systems of military personnel evaluation currently in use. If 
this its the case, why then have there been no changes in the 
systems? 

To be sure, history is fraught with changes to the reporting 
systems. The U. S. Navy, for instance, used some 48 different 
report formats between 1865 and 1956.2 

The very recent history of the reporting system of the U. S. 
Army is a case study of itself. That organization had developed 

7Lieutenant Colonel W. L. Traynor (ed.), "Officer Markings 
a Attention,'' Marine Corps Gazette, XLVIII (November, 


Benen James P. Berkeley, ''Letter to a Staff NCO,'' Marine 
Corps Gazette, XLIV (May, 1960), 36. 


Picea int Dcaterd || 
JHarold K. Jones and others, loc, cit. 


3 





during the 1940's a ''forced-choice!' rating Sten Le Beset by 
difficulties, the ''forced-choice'' report was abandoned, and, in 
1961, a new officer efficiency reporting technique was adopted. 
Army publications in mid-summer of that year were busy educating 
the marking officer corps to the origin and capability of the 
new report. One reported 


All officers--rated and raters--are more than 
little interested in a centralized evaluation 
system that plays so important a part in their 
professional lives. Every competent officer 
wants to be rated fairly and equitably, and 
usually develops a similar attitude towards his 
responsibility for rating the performance of 
others. 


The new system emerged partly out of hundreds 
of such discussions (as above) of a more formal 
kind, over the past several years. It is safe 
to say that every known theory and system of 
evaluating performance, every reasonable combi- 
nation of rating methods, every strong and weak 
features of the old system, and every concept 
that might possibly have value in the new, has 
been a subject of study and purposeful decision. |! 
J y purp 


Appropriately secure in the knowledge that their new system 
was a product of keen professional competence, of experience, and 
of caution, the Army made its new system effective on | September 


1961. Figure 1, pages 5 and 6, portrays the new report form. 


lOThe ''forced-choice'' technique for rating personnel provides 


a check list of specific descriptive phrases, so arranged that 
their selection permits scoring but does not disclose their scoring 
effect. The rater, required to choose from among these statements, 
cannot be sure what effect his decision will have on the resulting 
rating for any individual. The obvious purpose of this method is 
to eliminate as far as possible any human bias by setting up a 
system in which the rater is prevented from knowing precisely how 
he has rated the ratee. For further discussion of this technique, 
see: William B. Wolf, The Management of Personnel (San Francisco: 
Wadsworth Publishing Company, 1961), p. 223. 

MaietCcr ant Colonel Robert C. Store, ''The New Efficiency 
Report,'' Army, XI! (August, 1961), 30. 
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The Army's wait for some judgement was not a long one. 
Just seven months after its inception, the new reporting device 
suffered the observation that ''unless we change the way we handle 
it, it seems likely that by 1964 it will have gone the way of its 
predecessors.!'!!@ And speaking of predecessors, the author recorded 

...during the last two decades the average life of any 

system has been little more than three years. Each 

new system is accompanied by bright hopes and glowing 

assurances that one of the knottiest problems of person- 

nel administration finally had been solved. And every 

time these hopes soon give way to disappointment, then 

to discrediting a ''new'' system which had too quickly 

grown ''old''. This cycle may represent some kind of 

progress, but the improved reports have not been forth- 

coming. !3 

It can, of course, be argued that such a single observation 
has only so much influence, is only so valid. And that is true, 
but the validity of the first judgment soon became significantly 
more obvious. Six months later it was reinforced publicly and 
its reinforcement included a plea for evaluation of the marking 
officer to be used in ''weighting'' the importance of his yore 
Four months after that came General Hall's appeal for a moratorium 
on PoinGeeee Next Major General A. S. Newman, USA, reviewed 
techniques for endorsing and rating Biicersee Finally, General 


17 


Hiester recommended a ''new'' system. 
I2colonel Bergen B. Hovell, ''Efficiency Reporting: The 
Practice and the Prose,'' Army, XI! (June, 1962), 25. 
13 ibid. 


I4E1 Paso, "Efficiency Reporting," Army, XI1 (January, 1963), 
baer 


RA eral WA nemeeekCel, [om-cic 


Veena A. S. Newman, ''Loyalty and Efficiency Reports,!' 
Army, XIV (August, 1963), 70. 


'7 General David W. Hiester, loc. cit. 
7 





A system, advertised in 1961 as product of "'every known 
theory of evaluating performance'' seems now in 1965 destined to 
achieve only the average life of its several predecessors of the 
"past two decades.'' 

The effect, if any, that the recorded instability in 
appraisal methods has had upon the appropriate selection of 
officers to be retained in the Army's professional cadre is not 
of immediate concern here. What is important to remember is the 
series of unhappy experiences which that service has encountered 
in attempting to make sweeping changes in their system. Important 
to remember, too, is that the current appraisal product of all 
. this painful evolution is yet a system which many consider to be 
somewhat less than satisfactory. 


The Army is not alone in its experiences. 


RecCehumliahine COnps (OT fiicer Appraisal!® 


The Marine Corps finished the second World War with much 
larger personnel appraisal problems than it had ever previously 
encountered. From an organization of 18,000 men in 1935, it had 
grown to one with 485,000 by 1945. To be sure, there was a 
reduction to be made in strength in the return to a peace-time 
force, but never again was the Corps to be the small group in 
which large percentages of non-commissioned and commissioned 
officers were personally acquainted. The need for valid recording 
of personnel capabilities and potential value was acute. 

Bor a more complete review of Marine Corps officer 
appraisal see: William R. Etnyre, ''Appraisal's Role in Marine 


Corps Career Management'', (unpublished Student Thesis, George 
Washington University, Washington, D. C., 1965). 





The late forties witnessed frustrations in personnel 
appraisal. Officers were evaluated using form NAVMC 652 PD, 
See Figure 2, pages 10 and 11. Non-commissioned officer 
evaluation used a similar form. The total appraisal situation 
was well portrayed in this published letter: 

In the old Marine Corps which we all knew and loved 

so dearly, normally every noncommissioned officer 

was marked all 5s (maximum evaluation) across the 

page of his service record book, regardless of his 

worth and regardless of the instructions issued. 

To correct that habit, and those worthless marks, 

in the new Marine Corps Manual and service record 

book there have been substituted new instructions 

and a new system of marking proficiency which 

ranges numerically from 0 to 9. 

In spite of very detailed instructions most seniors 

continue to give NCO's the highest possible mark, 9. 

This defeats the system and makes the marks worth- 

less. It also heavily penalizes those NCO's who 

serve under a marking senior who abides by the in- 

struction. | 

One month prior to that letter which concerned junior 
NCOs, the Commandant of the Marine Corps issued General Order 
72 which radically revised the evaluation technique and format 
for officers. Basically, the same reasons as Colonel Totman 
had identified were the cause for General Order ee Form 
652PD (Rev 7-50) became effective. (See Figure 3, pages 12, 13, 
14 and 15.) 

In the same month that the new order became effective, the 
Marine Corps was to become engaged in land-locked warfare in 
Korea. Their combat engagement was to last just three years-- 

MaLieutenant Colonel C. 0. Totman, Letter to the Editor, 
Marine Corps Gazette, XXXIV (August, 1950), 11. 

Oe aaltietn Ee SGUnyrC) Op. Cilt~,) p. 32. 
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NAVMCGSZPD 
REPORT ON FITNESS OF OFFICERS OF THE UNITED STATES MARINE CORPS 


(To be submined in accordance with Art. 137, U. S. Nevy Reguletions, 1920, and Art. 16-22, Merine Corpse Menust) 


eeeeeee@eeez#nt0#nHeees#et*t#eoeeetees? e eoeeste eesvseeee#eeeneeoeertereeeeteeseteeeeee +] eoeeeeeeeeeeeeeeeteeee ee eee eee @ Uz S. M. Cc: 
; ( Mame Surname first) (Rank) i 
Ship or station e«@@e@e#? eeeoeteeeoeeoeee#eteeseeeseeeeoeseeeseeeaeaseoeeveeeeteetereeeeeeeeeevee er eee seseeseeaeeseeeeaeseseeee ee @ 


Period covered . eeeeoeeeeee @ @ months, from eooeoeteoeeoeeeee*@ ee ee eee eee & to Se tee er ag eg” arcane oe 


“Hd be answered by officer reported on: ee nee PERMANENT SAMPLE 
eis NUMERICAL, Fl FILE: 


lL: Regular dutles RS AR re ne eee ee ° @eseeeeaeaeoseooeooeeaeaaeeeoeeneeeeoeaeeeeeeeeoeoastooeeoaeeoee 
aan Ee ae Re ae ra . 

as Additional dutles see ereneeeeeteeee eae Boge NOT: EI aes aces sstesesaes nace @ee@eee#e#ee#e Sic eee cece ae ae 

3. Wife's address eseee re a) MeN ES cece wihtsaneivonggaccee. @ee@eeeesuvee @eeeeee eraletelerece 

4. Name, relatlonshlp, and address of person other than wife to be notified in case of emergency.......... wees 


{ 
I t 

eeeeoee#es COO o em eee Heer HH eee EEO HEH HETERO GS SEE HEH EHH HOES YO HE SEH HEHE HH EH EDO EEEHO OSES HEH EEO EEE HSH H EEE EE EEE OOD 
i t 

eeeeteoeoeopeosreoeeaseeaaeeHeeeoeeteese taeeeaetaeeee ato og @eeeeesvenveeoesee U. 8. M. C 


" (Signature) (Rank) 
To be answered by reporting officer: 
; i 
4 
5, Re rtin officer Sieislorelenateteiens: ci erelerelelalcterelerel cies, eeeeaeaaeveee Peet @eeeeeaoee eaeaeteeoeoen eee e@eeoeveoaeseroeaegas VU. 8. eeeoeoeveoee 
porting ore , * Gitamed / (Rank) 


16. Method of rating —When rating this officer, consider carefully and keep In mind the following definltions, taking 


| 


Into consideration his length of service, the opportunities afforded him which might have a bearing on his 
performance of duty, his personal characteristics, and professional qualifications: 
UNSATISFACTORY.—Ineffiiclent: below minimum standard. 
FAIR.—Satisfactory; passably efficient; up to minimum standard. 
GOOD.—Average qualifications; efficlent, but to a less degree than “Very good.” 
VERY GOOD.—Above average; efficient; well qualified. 
EXCELLENT.—Highly efficient; qualified to a high degree. 
OUTSTANDING.—Superlor; exceptionally efficient; qualified to a preeminent degree. 
NOT OBSERVED.—To be used In all cases where the reporting officer has had insufficient opportunity to 
observe the officer reported on during the period covered by this report to permit a rating as to perform- 
ance of a particular duty, personal characteristics, or professional qualifications. 


| 7. Before making out this report, decide in your own mind on an actual officer in the grade of the officer now being 
reported on who, in your opinion, based on personal knowledge, is the outstanding officer of his rank In the 
Marine Corps; or 
Decide in your own mind the character attributes and professlonal qualifications which the ideal officer In the 
grade of the officer now being reported on should possess... 


i ST ow. : wane eis = 
a cee —_ * ; 





== 





8. Considering the officer reported on in comparison with your Ideal (7), and 
‘having in mind the instructions under (6) ‘Method of Rating”, indlcate your 
estImate of him by marking “XX” in the appropriate a below. 


Not observec 
‘ neatisfacto 
Far 


Very Good 
Outstanding 


Excelient 


od 
Prefowtian duty (based on eager . , 
(a) cet r duties ...... it ore teciiginciihc were cs! case an rer ree re 
(bh) Additional dutles ......c..cccccccccenene he pie sintel fie envareie tie ele sce APC 
(c) Administrative duties ..........secceees comms oe 
(d) Executive dutles .............. Cone. seedebeccccceresecsescecs — 
(') Handilng officers PEN oe er sear eeielneees s* errr rr err re are 
(f) Handling enilsted Men ........eeereosecevecs ‘a oes 
(g) Training troops ee a. os 
(h) Tactical handling of troops (unit appropriate to officer's BtGae) sivas wate 


Appraisal form used for Marine Corps Officer 
Evaluation During the 1940's | 
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Figure 2 
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yf) 
(a) 
(h) 
(i): 
my) 


(hk) 


11. 


12. 


13. 


14. 


a ° 
° 
a er 2 © eee 


To what degree has he exhibited the following qualifications? Consider him 
itt Comparison with your ideal (7), and indicate your estimate by marking 
“xX in the appropriate space below. 


Not ohacr: . cf 
-! Outstanding 





) Physical fitness “(physical stamina; endurance under hardship, adversity, or 
CONSORT COS OU Le it ee en oe er ee ois 
Military bearing and neatness (dignity of demeanor; neat and smart appear- 
MING CMa ere eta heme cet ler uoneter eli a\s lols ds odeheualonenele ts fol cuovecehsvelonsuemenslay sists) © eae) steels evereusiereters 
a iericiot to duty (industry; the trait of working thoroughly and conscien- 
WRG SIVN D icgec. car aie Wien sese-e, sie oti cities oceania ee LimeW el eeer ee aens sy s1@ op uate eee PMD IN eis sup adele eles 
Cooperation (the facuity of working In harmony “with: others. military or 
AUN SE AIUD YU ese p emer ay ar rates pet ene ael ota arene Rey ee aa c's, Se alts. he. dsl ap Wiigcaie die ole ena telesai 
Initiative (the trait of taking necessary or appropriate action on own re- 
BONISIOIIIUY Veer eee eictia teens © cha ete tendons reds, deve os efile as si)site a bce tier iaiecerain, Ce 
Intelligence (the ability to grasp readily ‘situations and 
BENS UTA CU LOIN Foote gta 5 ah gcse een tenemos oe SS sina 'e Sv Blak gw OE eas dlctar ea Dis eneial'e w 0 Lic wees Picseie bos ed eee 
Judgment and common sense (the ability to think clearly and arrive at 10g - 
MCA LECOLICIUSIONIS ten Peas ace | ev cuwlsiw cr eee stacey letersi, Mi voided 4a) Bre ER, RY Wee) carne eee 
Presence of mind (the ability to think and act promptly and effectively in. 
an unexpected emergency or undcr @reat straint. ....... cee eee eee teen Rene Pe ne ree Pa 
Force tthe facnuity of cerrving out with encrgy and resolution that which Is . 
Beeslte nal Vester ccr enh UII IVC. GE TOUGCY Poe cccy ccc care Cuefese eas 6.64 « Gaia's be scolelse 
Leadership (the capacity to direct, control, and influence others and stiil 
OTST UCUULY re PU IT OR UN Ue oer ees se ine eee ea meee Mes oo ads «act tics 
Lovalty (the quality of rendering faithful and willing service, ‘and unswerv- 





ing allegiance WNIGOR ONY BTiGe all CIRCUSIIISUOMCCS Pico. co str ors Msi e 6 «oo «oie ePicusueld ote ioles oe Puceiece lees I 0 etalon: 
10. Has he any characteristics—temperament, moral, physical, etc —which adversely affect his efficiency?........ 
If yes, briefly describe them..............cseceeeees ere PRT Pee ea a ere Oe ee aterm atte werent: 


eeorsevuvoveseeee eee er eee eee eee ewe oes eseeseer ser ee sree ee esr eee oes eto seseeoeveeeeseee steer eweseeesese ee eee teseteeveeeteseeesteoesee 


During the period covered by this report, has the work of this officer been reported on elther in a commen- 
datory way, or adversely? If so, Indicate subject matter and date.................... re perme ate ‘ 


ooecevevoeveeeeeuesevoeeerteeeveeeeeetesevseeeeeseeee eee ee ee seevete eevee seeeeeseeeeeeeseeesevaeeveeeereeereeveere* mew eet eeveseseseeeeteseeeee 


During the period covered by this report was he the subject of any ‘discipiinary action that should be included 
MIS. TCCOLG 7 sass cas oo If yes, and !f nct previously reported to Headquarters, attach separate statc- 
ment of nature and attendant circumstances. 

In case any unfavorable entries havc been made by you on this or on a previous report, were the deficiencies 
notcd brought to the attention of the officer concerned? ..... seeeeee If yes, what Improvement, if any, h 
ete) a's g (6) A ats | aaah aa aR ee gray ar Aen or ee ornare en Ree vake bade Oni 4 ey oe spuapicenre eee Statotrceue 
If no improvement was noted, what period of time has elapsed fines the deficiencies were brought to his 
HOUICE ae Ga erie ee oe 6 6 ees pierce teceraueuane I c.g a Re & 

Considcring the possible requirements of the service In war, indicate Bue attitude toward having this officer 
under your command. Would you— 


ee@e*otPeecoeeoeeee eee ees @#ee88 


(a) Particularly desire to have him?............ (c) Be willing to have him?........ cc ccc cc wee cere eee 
(6) Be glad to have him?..........ceeceeceee00.+ (od) Prefer not to have him?............. MAE Eee 
If (d)}, explain briefly ee@eee ecoccnetes eeeeste @eeee 8 @ one. ee@enre @esetveoe tose e ese Pewee oes eesesegeseeeevese oe ee sos teeoeoeesvevedsenesn 
eeeseee @eeeeeees i 


. (To be enewerel! only when reporting on officers serving under revocable commissions). Do you recommend 


retention in the service after expiration of revocable period of commission?. aeons cada oe te aceon : 
(Yes or nee FT; negative give reasons) 


eeqgeeoeeseeovpeeeeeeteveereoeeve ee ee eee teeeens Sooo E He HHH HSS TR HHS HL HoKHH HOHE HHHHHHH HEH HEE HoT HHL EHH ee HeHOR EE ee ore eoeee ee eee 


/16. Remarks: (To be used for additional pertinent Information or comment, If any, not covered elsewhere ve this 
report) FA ee CR ee OR oa Es Oe aI RP 9 oP eeoeseeeee fee 
}17. Indicate your estimate of this officer's “General Value to the Service”, ‘using the ‘ratings specified In (6). 
eeeeeeee PME CTA SAO at ICTY OP) Ca at a aS Cok CL Cs ORO Cae OSM Gan Oreo LV ag 7 1 ONES CI IR EO ORL SAO TO it aS, REC CeCe Te EO SS Cet Te OO ft) OOS) ONC 
18. Having in mind the special fitness of this officer and the efficiency of the naval service, I certify that te the 
best of my knowledge and beilef all entries made hereon are true and witl.out prejudice or partiality. 
‘ ing | 
oa gietaletatel sists! c10tsiel6 sali WCE Cee Ore hank, @eoeeeeeseeveeeoerne . 8. Re ee 
(Signature) (Rank) | 
e eeoecese eee eee eeseeeoeseseesese eed ed ‘i i SOMITE NE Ss « 2A | 
(Dae) oe MES ee wie (Duy) 
; : a ‘ween 125959 5.19.48 335m, | 
fee _ ae ital 
PARSON MR MONTEREY Fg, ee ge eed) 
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U. S: MARINE CORPS var: BF 730. 
Re Sete Fon Gal aye LUE 

»ECTION A (To be completed by adjutant or unit personnel officer) 

1. Wee eavale ate ey aeete ts snbaineecadusieccd.-te 1 ten enter ace ass, nape lias ee DC oc es, le 
(Last name) (First name) (Initial) (Grade) (8ervice number) 
2. Organization | 
3. Primary MOS Additional MOS's 
4. Occasion for report (check appropriate boz): . 
O Annual (J Detachment of officer 01) Change of report- C) Concurrent C) Special (Explain on ii 
reported on ing senior : report below) 





Months ......... 





& Period covered: From —.~ We .. bo 


6. Periods of nonavailability (30 daya or more) (Explatn) = enna eeeeeeeeeeee nee eeenee 


SOE SSE SES OE Se RES FO Tt eG ES EGS 6 3S EF SE OE PROG BETES OO SS SSE SOOT CAR SPSS SET OSS] LPO OH OOS Cees wee 





© ert Oo OS® OOF He TOS CHT OT OF OT CSE t HFSS TCE DOSS OST E ST 


7. Duty assignments during period covered: Regular (Dates, descriptice fille, and duly MOS) 2.22... --neenenaneceeveceneenceccecctcoccecncenecs 


ORO SSS SES Se MESS Oe SOF POKES TEGO TEST See Pe EP Ce SSOP Se + PES Se SESS OE BES AF Os OS REP OSs HEP Cae Et Goeee Oe cons 





en ed a i ee me Se de OP ee ee ee ee Oe 








ee SE BS SOE EE OE eS FOE BF OSS SOOT OORT ES BE oe SOHO BESS ecorecacteenses) 
4 


Additional (Deser{ptive title and number of months) 


On EE Se & OBESE cs EEO OES OES COD POS OP SE PHS PES OES Se SOs 8 eS PE PO Oe TG SS Pe oS me OP Goa dee FLO SORE SS SO SSS ARO SSS SES GET ES SSE COB SET OS REMORSE Ot COE eD 


PO 08SEC SS £228 OO 6 6 O8 OS OE OSS OHS © ORSESS OS) 365 OOS 6S8 SH 68 Cr BE SF OES BOSS CSS PSS ESO CSS SS GO SPS 8 OS SSS CODES OES 9 SSS FOS SS SSE OHSS THK S E> SSS S TSS OO SSH STOTT SHOOTERS SHY SOSOEBED eege 


8. Officer’s preference for next assignment (1st choice) = nnn nnn nnn ann anne een ner nnnnnrnnnnnes tn cece ence nec e enc nes nes ens cecmenenesserensonsereeremnenss 


(2d choice) oF Ww eee COS SSS eo Oe te SBMt Te 26 See eee BE SU Ae OO eM OS SSE eee ees ($d choice) PES Soe ete or SBC ODSe CeCe seteresetome 228 Ae DOSS Ae Cet oo ee eer eben ee 
9. Name of reporting senior OOS S Oe TSE EO ORSD & eos ER SE CS ee ad Be 9 © ee On ee Ee be SS OO Grade eee &et See Cet ens C2288 UB... SOCREP SEP ee 
10. Duty assignment OS Ba HB OFS Ss SEBS S FASB ERSAEE SES OOD SE 9 OO SDS COE SSS ETS OE ESET OS OO RTOS ETS Se SoS eS ee eeses Bet we 8 O8 Oe 2068 2282 F688 OC CED SES OCTCRODEROO 


a 8 et 


|SECTION B (To be completed by reporting senior) 
}11. Recommendations for officer’a next duty assignment: 





12. During the period covered by this report: 





Yes No et 


(a) Has the work of this officer been reported on In a com- O If Yeq in (a), (0), or (€), and a réport has NOT been 
meodatory way? 0 jubiastced to the CMC,” atlach separate siacceniae of 


(bd) Ilias the work of this officer bean reported adversely? 0 0 nature and allend ne etreumstances. I a réepor hae 


been submitted tothe CAC, reference such report below; 
(c) Was he the subject of any disciplinary action that shoyld 0D Oo 
be included on his recopdf 






t. we 





13. Entries on thle report are based on (Cheek appropriate box); 








~ © Dally contact and clos Preqient observations CG Infrequent observations 
cat edtloa of his work 0 of his work he of his work 
14. Remarks: “ a | 
= ae b@—e2296-1 
Critical Ine-de+: Reps mplemenied by General Order 72 
r Guile 3 


ee ee ee 
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SECTION C (To bc completed by reporting scntor) 
DIRECTIONS 
1. This section contains 27 elements on which the officer {s to be ranted. For each clement five levels of performance aro defined by ex 


ampics. The examples do not cover every possibic type of behavior for the cloment to be rated, but are typical examples of performance 
at the various icvcis. 


2. flend ane eonsidor all Ave lovola of performance which are dofined for each olament. Dotermine which tovol most proporly desoribes 
the officer, and record an “X” in the box above the selected example. Mark the “unknown” box whenever you havo insuflicleot infor 
mation to make an cvaluation. 


3. Follow this procedure until you have recorded a mark for each of the 27 eicments. 
I. PROFICIENCY IN HANOLING ADMINISTRATIVE DETAILS 


1, UNDERSTANDINO INSTRUCTIONS: 
O 


Understands instructions 
with a minimem of elab- 
oration, 


Grasps Instructions qaickly, 


Misunderstands Instructions. Is alow to grasp Instructions. 
compiotely, aod eccurately. 


Vokoorn Orasps paid the malo 
points o 


instructions. 





2% SCHEDULING WORK: 













0 0 
Uokoown Echedulcs work 80 poorly Makes Ineffective allocations Bchedules work soestocover &chedules work so well that Distribntes tims and effort 
that the actieities of others of tims and effort. the important phases of . all phases of assignments are £0 that all phases of assi¢n- 
are blodercd. ast ignmaote. covered. ments are covered in 8 pare 
: ticularly aMicient manner, 
% CHECKING ACCURACY OF WORK: 
0 . 
Unkoown Overlooks oomerous serious Overlooks serious errore Overlooks only minor errors. Overlooks only ¢ faw mince Overlooks n0 errors. 
errors. occasionally. errors. 
4, WRITING LETTERS AND REPORTS: 
0 ‘ 
Unknown Frequently writes unaccept- Writes acorptabla latters of Writes ecoeptebie letters or Writes lotters or reports Writes superior lelters or 
shia letters or reporte. reports only after receiving reports, which are clear and wall teports on dificult subjects. 
suggestions for extensive 6 pressed. 
revision. 
& GETTING COOPERATION? 
0 0 
Unknown Aotagonizes many of those Makes littia attempt to get Enlists cooprration fo Im- Eollsts orc petnt ton io ail Oets the full snd active 
whose support Is essential. cooperation. tant phases of his work phows of hla work by dcal- support of all concerned 
om those concerned. ng tectluily with those con- tbrougb his tactiul and 
, cerned. persuasive manner, 
@ PRESENTING FINISHED WORE: 
O O 0 
Unkoowo Presents work lo such dl» Presents work {a such form Presents work Ja such form Presents @ork lo ¢uch form Presents work so orgnoleed 


organired form that it gives 
aimost o0 basis for action. 


7. DELEGATING AUTHORITY; 


Hesitates to deicgate 


Unkoorn 
necessary anthority 


that it givee lacompiate 
basis for action. 


that ection can be taken. 


that necessary action Is 
clearly indicated. 


Il. PROFICIENCY IN SUPERVISING PERSONNEL 


Makes overlapping or vague 


dalegation of authority, 


0 
Delegstes snthority 
adequate efficiency. 


to obtain Dalegatca enthority eo well 
. thet eiciency ts assured 


that setion can he taken 
quickly and with confidence. 


Makes clear-cut delegations 
of authority resultiog fa 
maximum efiictency. 





Unknown Crentes resentment by el 


arbitrary manger lo whie 
ha gives orders. 


a 


delegated to them. 


10. FEVELOPING TEAMWORK: 


& GIVING ORDERS AND {NSTRUCTIONS: 


Obtalos submission to orders 
b 7, bis reilance ob anthority 
alo 


2 SUPPORTING ACTIONS OF GUDORDINATES: 


ordinates. 


b] 


Obtains compliance witbout ° a Achieves wiliing compllence 
arcusing resentment when [ 
giving orders. 


4 < e 


7 considering the se 
of suhordinates when giving 
orders. 


-respeet 


Inspires enthusinstlo coo 
eration by the uso of tact In 
giving oeders. 


dalcgated to thom. 


0 





CO O M 
Unknown Distinimns responsibility for Does fot support actions Backs op actions taken under 3 =©Dacks up actions tsken undef Takes re«ponsiblilty for sub- 
subordinates’ actions taken tnken under authority that specific anthority delegated dele authority delegated ordinates’ actions oren when 
under the authority be bas ba has delegated to sub- to subordinates. subordinates. subordinates exceed authority 








‘e, Res 4 


be 


13 


Unkoowa Neglects to darclop cooper- Makes littia effort to develop Develops adequate coopera- Develops good team work Devalons outstanding team- 
ation and teamwork among cooperation and teamwork tion snd teamwork among which results in a0 effective work which results in mazt- 
bis subordinates. among bis subordinstes. bis eubordinstes. organization. tam effectiveness. 

[@—42330-! 
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11, MAINTAINING RELATIONS WITH SURORDINATES: 


Unknown Fails to malntaln discipline Maintains discipline and tbe Moalntains friendly relations Assoclotes with subordinates " Attalns a high javal of dis- 


and the respect dua an officer = respect due an officer In bis witb suhordinates without {n a mMonner which insures clplina and respect from sub 
in his pesition because of Position with difficulty be- loss of disciplina or tha the respect due him asa ordiontes through his 

undue familiarity witb sub- cause of undue fomillority respect due bis position. auperior officer. (rlandly but dignified oon- 
ordinates. with subordinates. duct toward thom. 


itl. PROFICIENCY IN PLANNING AND DIRECTING ACTION 
12, SOLVING PROBLEMS: 


O O O O a 
Unknown Fails to solve probloms com- Makes Inadequate solutions Bolves day-to-day problems Bolves diMcult problems by Solves very unusual prob- 
monly encountered in his to problems ho could reason- by moking use of existing making adaptations of exist- Jems by Loganious proced 
work. ably ae pected to bandle tesources. ing resources, 
successfully. 


13, PREPARING PLANS: 





























Unknown Prepares Inadequate plans. Prepares plans based on only Prepares adequate plans Prepares tborougb plans Prepares highiy effective 
* obvious factors. empbasizing the obvious based on an understanding of — plans based on a thorough 
factors. ail factors. analysis of all factors. 

14, TAKING PROMPT ACTION: ie 

O O O 

Unknown Fails to act when decisions Hesitates or puts off making Usually takes pecan ao Consistently takes ees tl Takos prompt action !n un- 

are needed. needed d ons, tion witba minimumofdelay. action to meet established needs. uous) or compilcated aJtua- 
i ons. 
1S. MAKING CORRECT DECISIONS: 
} Unknown Frequantly makos unsound Occasionally makes qnestlon- Usually makes adeqnate Usually makes good decisions Mnkes excellent decisions 
ur questionable decisions. able decisions. decisions based on reasonable sbowing sound evaluations of which exactly Ait all the 
fnterpretation of facts. all tba factors involved. factors involved. 
¢ 

16. MAKING FORCEFUL EFFORTS: ‘ 

Unknown Sbows no vigor and force in Exhibits little vigor and farce Usually vigorous and forceful Pursues objectives of the or- Mokes artramely vigorous 
bis efforts to achieve objec in bis afforts 1o achleve In bis efforts to achleve gadlzation with vigor end and forceful efforts to acblev 
tives. objectives, objectives. q force. objoctl ves. 

17, ABSORBING MATERIALS: a ; 

0 O : 0 O 

Unknown, Delays operations because of Achieves inadequate results Learns rapidly enougb to do Acbleves good results because Achieves excepifonal results 

slowness In absorbing facts. because of slow learning. bis Job in an acceptable of capacity to leagn involved because of lils unusual 
manner. materlals rapidly. ability to learn. 
iV. ACCEPTANCE OF INDIVIDUAL RESPONSIBILITY 

18. CARRYING OUT ORDERS AND DIRECTIVES: 

Gy O @ O fa] 0 

Unknown Freqnéntly cclays compliance Sometimes delays compliance Carries out orders aod Carries out orders and * Carriles oul plowiptly aod 
with arders and directives, witb orders and directives, directives without undue directives prompUy. . @ffectively tha spirit aod 

delay. fatent of orders and 
directives. 

19. COOPERATING WITH ASSOCIATES: 

0 s) s : 

Unknown Cooperates grudgingly witb Gives assistance ta associates Cooperstes wiilingly witb Voluntarily assists associates Is alert lo offer assistance to 
associotes. when requested to do so. associates when called upon, whan belp |s required, ae Ty when belp is 

“ Ac a 

2. ATTENDING TO DUTY: = 

i oO 0 ‘ 

Unknown Raquires constant supertl- Works jus? hard enongh to Sbows scceptable industry in Works hard and willingly to Does attra work voluntarliy 
sion to keep bis attention get by. } bis work. achlave objectives, {s) order to achieve 
on his assigned dut hs. oljectl vos. 

21, MAINTAINING MILITARY APPEABANCE: 4 “ 

0D 3 
pknown Appearance and beasrin - Appearance and bearing Presents a good appearance Appearance and bearing Appearance and bearing 
mene iheeptore with bis ctlectl vee detract somewhal from his aod bearing. create 4 distinctly favorable Inspire a blgb degree of 
ness, affectiveness. lo pression. confidenos. 
22. CONFORSUNG TO STANDARDS OF PERSONAL CONDUCT: 
0 

Unknown Reduces hisefiicicncy or dis- Docs not altsin bis full Follows acceptable standards Malntalns bigh standards In {na distinct cradit lo tbe 
credits tba service by noncon- efficiency because of occasional in bis personal conduet. his persona! conduct. servico Ly niuatulnling excep 
formaace to screpted stand. laxity in bis persona) condnet. tlonally bigh standards of 
ards of personal conduct. ‘ personal conluct. 

23. HANDLING PUBLIC RELATIONS: 

a Handles publio relations in Overicota opportunities to In bandling publie rajiations Is oler? to opportunitias to Creates opportunitlas to 
sucb a mander as to crente ' +e = 2ned public relations, usually creates a favorable furtber g publio relations, edvance best interests of 
antagonism Im presaion. tbe service. 

; NO 0ra2e-k 
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V. PROFICIENCY IN DUTY ASSIGNMENTS 


24, APPLYING TRAINING AND INFORMATION: 
Unknown Makes serfous mistakes in Makes occeptahie anpileation Makes acceptable appliention Mokea skiiled application of Demonstrates ao unnasually 
applying fundamentals of of his training and information oj his traintog and inivrmation bis training and tolormation hich degree of shill In applye 
bis traloliog. ooly Eo routine problems. fo most probiems. to most problems. ing his trainice and loformae 


tion to all prodiems. 





23. ENIPROVING EFFECTIVENESS: ‘ 


Unknown = Orerioeks opportunities Makes limited effork to Accepte fall ad to Ts alert to opportunities to Actively eecks out opporta- 
offered lui to improve his improve his effectiveness. improve his eflectivaness. improve bis effcctivences. nitics to lroprove bls 
eflectivencss, eflectiveness. 





26. PROFICIENCY IN a DUTIES: 


C) 

Unkoown = Perferme ince uately to Performs adequately lo routine Performs odequately lo deallog Performsexcclientiyloall - Dees exceptional work oven 
many phases of regular phases of bls reguiar duties. gs all probiems encountered phases of his regular duties. Jn the most diMeult pbases 
duties. in bis regular duties. of his regular duties, , 

27, PROFICIENCY IN ie DUTIES: i 
5 

Vnkoown Perlorms ined uate] Performs adequately in routine Performs odequstely in dealing Performs exceliently in all ' Does exoeptional work even 
many phases of hiss fione phoses of bis additional duties. with ali problems eocountered phases of his additional dotics io the most diiticult pbases o 
dutics. to bis additonal daties. . e -his additional dutics, 


SECTION D (To be used by reporting ser:ior, when appropriate) 
Record here any comments necessary to clarify specific ratings made in Section C 
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SECTION FE (To be completed by reporting sentor) 
I CERTIFY that to tho best of my knowledge and belief all entries made hereon are true and without projudice or partiality. 


Ei Qe ite SD 1 A CCD CE SSE OS SOS SO See ES 





ae ES Bignatare of reporting senior) . (Date) 
SECTION F (To be completed by officcr reported on) ap 
I have secn this compicted report: : 
OC) I have no statement to make. . . 
heck 
ee One) C) I have attached a statement. 7 
aa. eee eee ——Bignalure of olloer reportedon) =~ SCStStC<CS;7;7 }STSté<~S;S; ; COS kl 





SECTION G (To be completed by reviewing officer) 


an eG osee 











Name of revicwing officor....... 





Duty nssignmert 


ae nome 


tiepaspes 2 fo Ree Rey): Fo quit 3 (curt sued) 


Wt 


i) eleeeetge 


mr 


tf e* 





eighteen months more, it is to be reported, than NAVMC 
form 652PD {Rev 7-50) was to remain effective. 

Ftnyre states that ''the new system was riddled with problems 
from its inception. Reporting seniors Seen sis. This may be 
a harsh judgment; re ie selection boards found almost 
no means to make comparisons of officers due for consideration 
for promotion. Whereas discrimination in marked values were 
difficult to distinguish under the old system of the forties, 
they could now distinguish little or nothing under the new. 

lt must have been a most difficult decision, but the Marine 
Corps was to return to essentially the same reporting system 
which it had used prior to General Order 72. {t is true that 
the new form of 1952 did not look exactly the same as that used 
in the forties, but it is also a fact that the items to be con- 
sidered and the rating scale to be used were nearly identical 
to the old form. Figure 4 is copied from the form in use today; 
it differs from the 1952 form only by its inclusion of item 19b, 
(See figure 4, pages 17 and i8). 

Having returned to a system of officer evaluation which had 
already been once rejected, the Corps was to find through the 
years that results of that system were frequently to be less than 
desirable. Recall the statement of Major General Berketey on page 
3; to it can be added comments of other prominent Marines. For 
one example, Major General Donald M. Weller, USMC, while Deputy 


Chief of Staff for Personnel, stated: 
Alibid., p. 37. 
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OFFICER FITNESS REPORT—U.S. MARINE CORPS 


NAVMC 10147-PD (REV 4-41} 
(SUPERSEDES NAVMC 10147-PD (REY 2-37} WHICH MAY BE USEO 


SECTION A 





(Last name) (First name) 


2 ORGANIZATION 


3 PRIMARY MOS 


4 OCCASION FOR REPORT (Check appropriate bor) 


O SEMIANNUAL OETACHMENT OF OFFICER REPGRTEO ON 
(Enter unit or station to which detached 
on line below) 


5 PERIOD COVERED FROM ane 








(initial) 


TO 


ALt OTHER EDITIONS ARE OBSOLETE) 


USMC 


(Grade) (Service number) 


ADDITIONAL MOS'S” - - = 








OTHER 
(Explain on line below) 


CONCURRENT 
REPORT 


CHANGE OF REPORTING 
SENIOR 


LJ 


MONTHS 





(Day, month, year) 


6. PERIODS OF NONAVAILABILITY (30 DAYS OR MORE) (Explain) 


7, DUTY ASSIGNMENTS DURING PERIOD COVERED: REGULAR ( Dates, descriptive title, and duty 10S) 





ADDITIONAL ( Deseriptice (ttle and number of months) 
MARKSMANSHIP QUALIFICATIONS (Lieutenants and Captains ) 


@ WIFE'S ADDRESS 


9 AGE. RELATIONSHIP OF DEPENDENTS REQUIRING TRANSPORTATION 


10, OFFICER'S PREFERENCE FOR NEXT ASSIGNMENT (Jaf chotce) 
(£d chotce) _ 


(Signature of officer reported on) 


(Day, month, year) 

















_ (Sd choice) — 


( Date) 





SECTION B (To be completed by reporting sentor) 


11, NAME OF REPORTING SENIOR 
2 OUTY ASSIGNMENT 
13, RECOMMENDATIONS FOR OFFICER'S NEXT DUTY ASSIGNMENT. 








14 DURING THE PERIOD COVERED BY THIS REPORT 
(a) Has the work of this officer been reported on ina 
commendatory way? 


(6) Hasthe work of this officer been reported adversely? 


(c) Was this officer the subject of any disciplinary 
action that should be inciuded on his record? 





15a ENTRIES ON THIS REPORT ARE BASED ON (Check appropriate bor) 


OAILY CONTACT ANO CLOSE OBSERVATION 


FREQUENT OBSERVATIONS 





GRADE us 


yes 


ae 


If YES in (a), (6), or (¢), and a report has NOT been submitted to the 
CMC, atlach separate statement of nature and attendant circumstances. 
Ifa report has been submitted to the CMC, reference such report below: 


lhe 
airy 





tS TO BE COMPLETED ON ORGANIZED RESERVE OFFICERS 





INFREQUENT OBSERVATIONS 
OF THIS OFFICER'S WORK 





SCHEDULED DRILLS 





ATTENDED 








505 





OF THIS OFFICER'S WORK 








OF THIS OFFICER'S WORK 





Jfficer Appraisal Report Form Currentiy used 
by the Marine Corps 


Figure 4 
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SECTION C (To be completed in pen and ink by reporting senior) 


Considering the officer reported on in comparison with all other ®fficers of the same grade whose profes- 
sional! abilities are known to you personally, indicate your estimate of this officer by marking ‘‘X”’ in the 
appropriate spaces below. 


OUTSTANDING 


16. PERFORMANCE OF DUTY (Based on fact) 

{a} REGULAR DUTIES 

(b) ADDITIONAL DUTIES . 

{e) ADMINISTRATIVE DUTIES 

(d) HANDLING OFFICERS 

{e} HANDLING ENLISTED PERSONNEL 

({) TRAINING PERSONNEL 

(g) TACTICAL HANDLING OF TROOPS (Unit appropriate to officer's grade) 


17. TO WHAT DEGREE HAS HE EXHIBITED THE FOLLOWING? 

(a) ENDURANCE (Physical and mental ability for carrying on under fatiguing conditions) 

(+) PERSONAL APPEARANCE (The (raif of habitually appeoring neat, smart, and u ell-qroamed in uniform or citttian attire) 

{e) MILITARY PRESENCE (The qualify of mointoining oppropriote dignity and soldierly beoring) 

(d) ATTENTION TO DUTY (industry; the tratt of working thoraughly and conscientiously) 

{e) COOPERATION (The facully of working in harmony with others, militory ond ciahan) 

(f) INITIATIVE (The trait of taking necessary or appropriate action on own responsibility) 

(g) JUDGMENT (The ability to think clearly ond arrive at logical cancelusions) 

(h) PRESENCE OF MIND (The ability to think and acl promptly and effectioely in an unexpected emergency or under greal strain) 


e 


BEERS RR Eee eee 
BERBER SA Eee ee Bee aaa 
BRRERSSAL eas eee 


ET ERRH G2) Ree 





(i) FORCE (The facully of carrying oul with energy and reaalution that which ts believed to be reasonable, right ar duly) 
(j) LEADERSHIP (The capacity to direct, control, and influence others and still maintain high morale) 

_(k) LOYALTY (The quality of rendering faithful and willing service, and unswerving allegiance under any and all circumstonces) 
(1) PERSONAL RELATIONS (Faculty for establishing and maintaining cordial relations with military and civilian associates) 


BOURKE ETS eee Reece 
VCC CBEELUEE) GEO SRS 


{m) ECONOMY IN MANAGEMENT (Effectioe utilization of men, money and materiale) 
18, Considering the possible requirements of service in war, indicate your attitude toward having this ofhcer under your command. 


PREFER NOT BE WILLING BE GLAO PARTICULARLY 
Would you- C) NOT OBSERVED TO HAVE? TO HAVE? i TO HAVE? OESIRE TO HAVE? 


19, (a) Indicate your estimate of this officer’s ‘‘General Value to the Service’’ by marking ‘"X"’ in the appropriate box: 
NOT OBSERVEO UNSATISFACTORY BELOW AVERAGE ABOVE AVERAGE EXCELLENT OUTSTANOING 


& O LO Cj see CJ 





(b) Show diseribution of all Item 19. (a) markings awarded ofhcers of his grade for this reporting occasion: 


Eee = ae a Ae YC ry, rc (ems ly teem oes aes a fp le ay | 


SECTION D (To be completed by reporting senior In pen and Ink.) Record in this space a concise appraisal of the professtonal character of the officer reparted on. 
( This space must not be left blank.) 








Cr 





SECTION E (To be completed by the reporting senior) SECTION F (To be completed when required) 









( Check One ) 


I CERTIFY that to the best of my knowledge and belief all entries I have seen this completed report. ‘a c Have NeeteEMeAT i ‘ae 


made hereon are true and without prejudice or partiality. 


> 


S HAVE ATTACHEO A STATEMERKT 


r . 








(Signature of reporting senior) ( Date } (Signature af afficer reported on) ( Date } 


SECTION G (To be completed by reviewing officer) 





NAME OF REVIEWING OFFICER GRADE SS 





DUTY ASSIGNMENT Wit ALS 














* US GOVERNMENT PRINTING OFFICE 1961 0—591135 





ne a ee 


: Reseleiesunet Figure & (continued) 





The evidence is adequate to properly identify the 

best officers and non-commissioned officers, 

provided that fitness reports are not inflated. ..24 

It iS no secret, particularly among those who have 

recently served on selection boards, that there 

has been a tendency to inflate fitness reports. 

Obviously this makes the task of the selection board 

more difficult. It is more difficult to identify 

those with the greatest potential. 

..it should be clear that the key to the selection 

is the care and judgment exercised 2 commanding 

officers in marking fitness reports. *? 

Those statements, and many like them, suggest that the 
Corps was, and is, ''to live'' with a system rather than ''to have'! 
a system of officer evaluation and this may suggest criticism 
be given to the 1952 decision to take a ''giant step pact wsndance 
Yet, the recent experiences of the U. S. Army appear to confirm 
the folly of revolutionary changes and to suggest that the Corps' 
decision to reverse itself in 1952 was a pre-eminently good one, 
weaknesses of the system notwithstanding. 

And, when the editor of the Gazette spoke of selection board 
difficulties in making valid comparisons of officers because of 
weak fitness report preparation last November, he coupled with it 
this report of the Corps' most recent public re-commitment to the 
present system like this: 

... that's another reason why HQMC (Headquarters, 

Marine Corps) plans no changes in fitness report 

format. Comparisons are difficult enough to draw 


22F or more on the marking ''inflation'' problem, see Chapter 11. 


23 General Donald M. Weller, ''Personnel Policies and You,'! 
Marine Corps Gazette, XLIV (June, 1960), 13. 


2 em Eethybe. Op. Clty pp. 374 





without adding to the havoc of educating marking 
seniors with a new report. 


The Thesis 

\f military personnel evaluation in general can provoke 
such negative criticism from prominent sources, should we not 
ask: why? If Marine Corps personnel evaluation, in particular, 
can cause a Marine general officer to speculate that one of every 
ten promotions (''over the years our experience has been that they 
bat about 90%...'') is a questionable situation, should we not 
ask: what can be done to improve the matter? |f we can begin 
LOwlinprove the system, little by little, with no risk of loss of 
effectiveness as we now know it, should we not begin? 

It is our thesis that significant improvement in the quality 
of Marine Corps personnel appraisal can be realized by better use 
of the current reporting system. Our study seeks weaknesses of 
the system and examines some alternatives to them. Although 
some consideration of the rating scale will be made, we will not 
suggest revolutionary change to the format currently used in 
reporting. 

Probably, one of the major efforts to be made in overcoming 
problems of the system is in the application of electronic data 
processing (EDP). Eventually, a large application of EDP will 
occur. Our study of EDP in the report system is limited only to 
"initial'’ applications of machines in standard scoring of reports 


and to some uses of those scoring results. 


2>Lieutenant Colonel W. L. Traynor (ed.), "Officer Markings 


Get Special Attention,'' Marine Corps Gazette, XLVII! (November, 
1964), 6. 
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CHAPTER 11 
THE REPORTING ENV! RONMENT 

Some General Information 

Fitness reports, with almost negligible exception, are pre- 
pared at least twice annually for each officer of the Marine 
Corps. For various reasons, though, it may be that the annual 
average number of fitness report submissions per officer more 
closely approximates 3.5 to ho. ! Therefore, it appears that the 
volume of officer fitness reports is about 60,000 per year. That 
figure is important in considering machine (computer) time which 
might be required in computer applications. 

lt is best noted here that a sizeable portion of the 60,000 
reports may be ''not observed'' pene ea Any machine programming 
must be capable of handling that type of report. 
The Rating Scale and Normal Populations 

Marines are rated in three general areas: past performance 
of duty, personal traits and professional characteristics, and 
Serene eIeunaee both combat and general considerations. The 
rating scale to which the Marine Corps is committed is shown in 
Figure 5. The shaded marking-boxes which ‘appear between the 
marking classifications are dvailable for use only when considering 
the Marine's ''General Value to Service.''! 

lFor a complete study of submission regulations, see: U. S. 
Marine Corps, Marine Corps Personnel Manual, Officer and Non- 
commissioned Officer Fitness Reports, May 1964, Chapter 15, 
paragraph 15068. 


2y. S. Marime Corps, loc. cit. 
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| NOT BELOW ABOVE EXCEL- OUT- 
| ops. | uNnsAT. | AVE. AVE. AVE. LENT STAND ING 


1c naoao@oe@d 


Marine Corps Personnel Evaluation Rating Scale 





Figure 5 


What sort of a distribution of SAREE should the Marine Corps 
expect from this scale? Psychologists are agreed that ''psycholo- 
gical measurements, and such biological factors as height and 
weight, are distributed in approximate accordance with the normal 
probability curve.''3 Stated otherwise, ''it is well recognized 
that all, or nearly all, measurements of human traits and abilities 
result in distributions of approximately this form.''4 The pre- 
Sumption, and a basic assumption of this study, is that the 
Commandant of the Marine Corps should expect a normal distribution 
of markings over the scale from unsatisfactory to outstanding. 

At this point, let us briefly review the properties of a 
‘normal population'. The normal distribution curve is the 
familiar bell-shape graph as shown in Figure 6. The average 
value of occurrences within the distribution is centrally located 
at x, the mean. All other values deviate from the mean. A measure 
of their deviation from the mean has been called standard deviation. 
Standard deviation, commonly referred to by the Greek symbol ©, 
has been so defined that 99.73% of all items of a normal distri- 


bution lie within three standard deviations of the mean or average 


oN eeian L. Munn, Psychology: The Fundamentals of Human Adjust- 
ment, (Boston: Houghton Mifflin Company, 1946), p. 398. 
mn 


Joseph Tiffin, Industrial Psychology, (New York: Prentice- 
Hall Incorporated, 1952), p. 494. 
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The Normal Distribution 


Figure 6 


item. Six standard deviations, three above mean and three below 
mean, include approximately all items which make up a normal 
population. Or, in other words, the value (rating) scale of a 
normal population is covered by six discriminations when we speak 
of standard deviations.7 
For the unwary, the reminder is placed that we are not 
suggesting Marine Corps officers are a random sampling of the 
population of the United States. If, somehow, it were possible 
to compare the sampling and the population of the U. S. in terms 
of the characteristics included in the fitness report, it is 
possible that Figure 7 might show the relative distributions, 
except, of course, for comparative scale of drawings. The point 
is made to emphasize the Marine Corps officer group is a normally 
distributed group drawn from a much larger normally distributed 


group. 


p) 


For a complete discussion of normal distribution, see: 
Paul G. Hoel, Introduction to Mathematical Statistics, (New York: 
John Wiley and Sons, Inc., 1947), p. 28 ff. 
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Entire U. S. 


Ohta: 


Marine Corps 
Officer Pop- 


ulation 
see 













Likely Area of Entire U. S. Population From 
Which Marine Corps Officers are Selected | 


Figure 7 

Valid questions here may be these: Could the foregoing be 
one of the underlying causes of inflated markings which prevai] 
in the system? Is the officer marking First Lieutenant John 
Brown unable to sort out all the first lieutenants whom he knows 
and use their collective performances as a yardstick as the 
system requires? Or, as an alternative, is the marking officer 
comparing First Lieutenant John Brown with the portion of the 
entire U. S. population which he knows? 

While those academic questions plead attention, let us 
consider the coincidence that the most important property of the 
normal curve, standard deviation, divides the distribution into 
six groups (99.73% of cases lie within plus or minus 3aof x},,and 
that the rating scale to which the Marine Corps is currently 
committed also tends to divide the normally distributed officer 
population into six groups (unsatisfactory to outstanding). What 


is the implication of this similarity? 
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|f we were to superimpose the rating scale of the Marine 
Corps fitness report on the normal distribution curve--and 
this should be the intent of our rating effort--it appears that 
we are demanding a distribution of markings for officers of each 


grade as appears in Figure 8. 


: a 


x 
. 
N 


1 UNSAT. «1 B/A i =AVE A/A EX 1OUTSTD. 1 

ie 283 , A 3es6r7, meg4el, Bal, a ligeo7 1 2.34 

\ i 7 i i ‘ i ot 

1 1 1 i ‘ ' 1 
' i i i ‘ \ i 

' ‘ i i 
Mica? 1 i i i i 


-30- -207 -lo 0c lo I op 30e~ | 
Superimposing Marine Corps Rating Scale on | 
Normal Distribution 


Figure 8 


The first unacceptable characteristic of the Marine Corps 
rating scale is immediately obvious. ''Average,'' a term generally 
connoting symmetry about mean, falls entirely below (to the left) 
of the mean. A very important first step toward inflated ratings 
has thus been committed by the Marine Corps rating system, even 
before the stroke of the pen of a marking officer. 

If the graphic superimposing (Figure 8) of the rating scale 
can give first insight to weakness of the system, then the question 
occurs: can the tabular superimposing of the rating system upon 
the normal distribution help the analysis? Table {| is such a 


tabulation. 
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TABLE | 






































| 
TABULAR NORMAL DISTRIBUTION OF MARINE CORPS OFFICERS 
) Normal Distribution 
Approx. No.||_ AVE) A/A | EX 1 | 
Rank | Officers | | 
204 
LtCol 222 565 
Maj 340 852 
476 1193 
1018 2553 


Suffice it to say that the completion of this table itself 


became academic after computation of the first four figures. Such 
a distribution ''demands'' 2.27% officers be declared unsatisfactory 
in every rank and that 13.60% of officers of a rank be declared 
below average. In terms of 60 general officers of the Marine Corps, 
this suggests that 9 of them are clearly of a quality below average 
or less; of 600 colonels, 95 are to be so designated. Now, this 
seems a false and unacceptable implication; and it's probably at 
least as false and unacceptable to the 60 general officers and 600 
colonels of the Marine Corps as it is to us. 

The first alternative to superimposing the full rating scale 
on the normal distribution is to disregard the ''unsatisfactory'! 
rating as a possible choice to normal marking. An officer who 
somehow should qualify for such an evaluation is apparently a 
special case and presumably will not long be an officer. 

With that very logical situation prevailing, the second real 
giant step toward inflated markings has been conceded by the system. 
Superimposing the remaining five discriminatory categories upon 
the normal distribution has been done in Figure 9. One unpalatable 
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Graph Superimposing Five Discriminations of the 
Marine Corps Rating Scale on Normal Distribution 


Figure 9 





matter is immediately obvious; the ''above average'' category is 
now at the center of the distribution; semantics (''Above Average’! 
now becomes the average) become more severely distorted. More- 
over, 630 Sere (3.6%) of the Marine Corps should yet be 


clearly designated below average or less. 


a 





The trend of the argument seems obvious: conceded an 
inch, take a mile. Shortly, only excellent and outstanding 
marks are awarded; professional discrimination, vital to the 
welfare of the Marine Corps and the Marine, is almost non- 
existent. And, if this seems an unfair conclusion, let us 
investigate some statistics. 

The Administrative and Records unit, Officer Detail Section, 
Assignment and Classification Branch of the Personnel Depart- 
ment, Headquarters Marine Corps conducted a survey of submitted 
fitness reports in 1959. All fitness reports submitted upon 
officers of the 2d Marine Aircraft Wing and the 2nd Marine 
Division between September 1958 and April 1959 were carefully 
tabulated. The results seem eloquent argument for revision 
of the marking cues on the Marine Corps rating scale.° Table 
|! tabulates the results of the study; table II is located on 
page 29. 

Graphing of the statistics, in comparison with the normal 
distribution makes an interesting study too. For that study, 
see Figures 10 a-h, pages 30, 31, 32 and 33. 

There are some closing considerations to be given to the 
rating scale and its possible change. First, confronted with the 
rating dilemma as it has been presented, some marking officers in 


the past have found their own solution to the limited number of 


Results of this study are included in: U. S. Marine Corps, 
unpublished letter AO3E-rlm, 27 October 1959. 
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Figure 10a. Distribution of 2nd Marine Division officer 


(lieutenants) ratings for penkee Sep 1958 to Apr 1959 
OMT ith normal distribution. | : 


PCCD, 

AT XXN ELI 

Aili Sst [i 
71 || Jt Se 


7 U B/A A A/A EX O ; 
Figure 10b. Distribution of @nd Marine Air Wing officer 
(lieutenants) ratings for period Sep 1958 to Apr 195% 
compared with normal distribution. 
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7\_ | TSX 
es == 
A/A EX O 
Figure 10c, Distribution of 2nd Marine Division officer 
heal deere. ratings for period Sep 1958 to err 1959 
normal distribution. 


Figure 10d. Distribution of 2nd Marine Air Wing officer 
(captains) ratings for period Sep'1958 to Apr \1959 » 
compared with normal distribution. 
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Figure 10e. Distribution of end Marine Division officer 
(majors) ratings for period Sep 1958 to Apr 1959 
BS " a Q : 


batman! 


TnX 
Figure 10£. Distribution of 2nd Marine Air Wing officer 
(majors) ratings for period Sep 1958 to Apr 1959 
aS compared with normal distribution 
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Figure 10g. Distribution of 2nd Marine Division officer 
(lieutenant colonels) ratings for period Sep 1958 to 
At 959 as ompared with normal distribution. 


~“ 
= 4h 
: WA EX O 
Figure 10h. Distribution of 2nd Marine Air Wing officer 


(lieutenant colonels) ratings for period Sep 1958 to 
Apr 1959 compared with normal distribution. 
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usable discriminations by marking on the lines between marking 
columns. This practice resulted in a Marine Corps regulation as 
reported in the Gazette: 

...-CMC (Commandant of the Marine Corps) has ruled that 

'fence-straddling'' by reporting seniors in marking 

items 16 and 17 of fitness reports is prohibited. The 

new policy, which stops marking ''on the line'' between 

various marking columns (e.g. ''Excellent/Outstanding'') 

will be announced in upcoming Marine Corps Bulletin... 

Finally, that comparisons are difficult cannot be denied. To 
change rating scales in the past was to invite disaster; the Marine 
Corps’ 1950-1952 personnel appraisal decisions are a classic 
example. And, the frequent past statements of caution which 
warned of the impossibility of comparing fitness reports (between 
systems) if we were to change rating scales in ''mid-stream'' surely 
had high validity. 

No longer is that true. Standard scoring has long been a 
valid statistical concept. (This paper considers standard scoring 
of fitness reports in Chapger IV) But, the arithmetic manipulation 
required in the processing of a large volume of fitness reports, for 
example, in an effort to achieve standard scoring, was not feasible. 

No longer is THAT true. The computer has rendered that in- 
feasibility and the ''no change’! ppamesophy a myth. To be Sure, 
change should not be made for Saenael « sake, and caution is yet the 
order of the day--it always will be. 

The Reporting Scheme and Some Problems 

Current regulations require submission of appraisal forms 
(refer to Figure 4, page 17) by the commanding officer of the 

‘Lieutenant Colonel W. L. Traynor (ed.), ''Fitness Report 
Change,'' Marine Corps Gazette, XLVI! (September, 1963), 2. 
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Marine concerned. For example, let us assume that Lieutenant A 
is about to have a fitness report prepared in his case. The 
lieutenant's position in the command hierarchy of his battalion 


is shown tn Figure Il. 


LtCAA 


elelolu} = Lalu, mil ole 





Company Company Headquarters 
hic hipll Company 


Compan 

Hat lpi 

Schematic Depicting Battalion Command Hierarchy 
Figure 1] 

Although techniques surely differ, normally the company 
commander of Company A, CpA, in informal review with the company 
executive officer, Q, will prepare a ''rough'' fitness report upon 
Lieutenant A. Current instructions say that Lieutenant A will be 
compared with all officers of the same grade whose professional 
abilities are known personally by the marking officer. 

The company commander then furnishes the ''rough'' report to 
the battalion commander, LtCAA, who is charged with the responsi- 
bility of preparing the official, permanent report. LtCAA may 
precisely duplicate the report, he may slightly alter the report 


as ''roughed'' by the company commander, or he may ignore the ''rough!! 
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entirely. The final evaluation of Lieutenant A rests almost 


entirely with Lieutenant Colonel AA. 


Figure 12 shows Lieutenant A's position in the command 


ColAAA 
LtcDD| 


hierarchy of the regiment. 


Regimental 
Headquarters 
Company with 
various staff 
and other 
sections 


Ist Battalion 


Schematic Depicting Regimental Command Hierarchy 


Figure |2 





To complete the reporting scheme, the official report which 
LtCAA has prepared is submitted to the regimental commander, 
ColAAAA, who acts as a reviewing officer. Although the reviewing 
officer certainly has the prerogative to question the ratings of any 
or all reports, it may be that the review has more likely become a 
test of the technical correctness of the report and little more. 

Captain B's personal report is likely to be prepared in a 
''rough'' by the battalion executive officer, MaC. As before, LtCAA 
prepares the final, official report and it is further submitted to 


Colonel AAAA for review. 
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lt seems safe to suggest that reports for officers are 
generally made in a similar way regardless of location, rank, 
duties, or organization. 

What lies at the roots of problems which prevail in such a 
system of appraisal? 

It can be reported that the common vagaries of such performance 
appraisal are word-worn; reference after reference belabors the 
several pitfalls which are constantly present in the system. Some 
apply to the mechanics; most apply to the perpetration. And, com- 
mitted already to acceptance of the Marine Corps' current format, 
let us direct our attention at this time to the difficulties which 
the system encounters as result of the interaction of people--marking 
officers, if you will--with it. We can do this, too, armed with the 
Supporting thought that ''the success of a rating plan depends less 
on the method, or rating form, than on (its proper NENG aeaen ees 

About forty-five years ago, Thorndike investigated and 
reported the phenomenon called ''halo'!! Concanens }t occurs there is 
a natural tendency for the rater to be influenced in rating one factor 
by the kind of rating he gives on another factor. [{n fact, the 
individual rather tends to give each man approximately the same 
rating on all factors. !{f a rater has a general feeling that a man 
is good, he will rate him high on all factors--and the reverse is 
true, too. Etnyre likens this to the '''good fat man' suddenly having 


no weaknesses, including even 'personal appearance’ or 'military 


i110 


v 


presence!.., 


Sain Howell Thomas, Industrial Psychology, (New York: 
Holt, Rinehard and Winston, 1958) p. 61. 


Je L. Thorndike, ''A Constant Error in Psychological Ratings,'! 
Journal of Applied Psychology, IV (April, 1920), 25-29. 


SR CAVES), Op. Cit. . p. 58. 37 








pevonamunallol. sets of ratingsmade by different appraisers 
will show tendencies on part of some raters to differ from others 
in a constant manner. Two of these have been identified: (1) the 
leniency error, and (2) the error of central tendency. 

The leniency error refers to those situations in which the 
rater tends to assign high ratings to most individuals. Infrequently, 
the ''harsh'' rater will deliver the opposite trend. 

Some organizations have experienced raters who tend to avoid 
rating individuals high or low, and whose ratings tend always to 
be centralized about the mean of the scale. Ghiselli and Brown 
cite an example of three raters appraising seven different in- 


'l Figure 13, page 38, shows graphically the ratings 


dividuals, 
awarded in these instances. 

Figure 13a shows the central tendency of one marker. Figure 13b 
shows the marker who has discriminated amongst the seven ratees, 


nearly across the entire range of possible grading. Figure lI3c 


identifies the marker possessing the tendency toward leniency. 





Marks Awarded to Seven Ratees by Three Raters 


Figure 13 


Megwin E. Ghisellit and Clarence W. Brown, Personnel and In- 


dustrial Psychology, (New York: McGraw-Hill Book Company, Inc., 1955), 
ouaes ba 38 





To be sure, it is important to observe that A, for example, 
has been awarded an eight on the one hand while receiving marks of 
11 and 12 from the final two markers. To be sure, too, evaluation 
of the reports with respect to one another has taken on a new 
dimension. What is the meaning of A's 8 from the first rater as 
opposed to C's 11 awarded by rater three? Or, more candidly, what 
is the meaning A's 8 from the first rater as opposed to F's 9 from 
the third? 

But how can a matter like ''constant error'' of markings be 
of import to the U. S. Marine Corps appraisal system? 

It is not difficult to build an example in terms of Marine 
Corps fitness reports. Let us suppose that a selection board (for 
promotion) is in session. Let us suppose, too, that there remains 
one selection to be made from two remaining candidates. In 
reducing the variables, let us suppose that the records of the two 
men in question, Captain A and Captain B, are identical in every 
way except that they have been marked by different observers. How 
is one record to be compared against the other in terms of leniency 
constants of the different observers? 

And, if imagination fs not our inclination, let us return to 
the. real world. The results of the fitness report survey conducted 
in late 1959 brought quick action by the Commandant of the Marine 
Corps. The Gazette reported that Marine Corps Order 1611.3A was 
‘putting the squeeze on officers! fitness reports.!!!4 

Among other things, Marine Corps Order 1611.3A no longer per- 
mitted the ratee to see the report completed upon him. Alsa, tthe 

Lieutenant Colonel 7, N, Greene (ed.), ''Fitness Reporting,'' 
Marine Corps Gazette, XLIV (March, 1960), 3. 
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order established new rules for the justification of 'outstanding' 
reports. 

Results from the order were quickly noted. Excluding Division 
lieutenants, whose percentage of outstanding reports was negligible, 
and Air Wing lieutenant colonels, the '59 survey had found approxi- 
mately 31 percent outstanding reports. Yet, the Gazette was able to 
report, shortly: 

"Its (Marine Corps Order 1611.3A) impact was felt 

on officer fitness reports for six month period 

ending 28 Feb 60; only a little more than seven 

percent were marked '‘outstanding.' There was 

another drop in July when only 6.8 percent of 

junior officers got the high mark.'' 3 

But, if the results were quick, they were not exactly lasting, 
and the Gazette admonished: 

"Since then (July) percentage of officers considered 

outstanding has been going up. 8.5 percent in August. 

13.2 percent in September. ...The facts, Marine. 

Colorful adjectives won't do...!!! 

One problem solved, or partially solved, frequently begets 
another in the real-world situation. Mindful of that, and with 
the fluctuating marking ranges recorded, how does the ‘excel lent' 
report of late 1959 compare with the 'excellent' report of February 
1960? And how does the February report compare with an ‘excellent! 
report of September 1960? 

The answers to those questions can be found. We have long 


known that standard scoring can work to reduce significantly the 


inequities suggested in the foregoing examples. 


bao 
Lieutenant Colonel T-. N. Greene (ed.), ''GO-I-N-G UP," 
Marine Corps Gazette, XLIV (December, 1960), 4. 
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Why, then, has standard scoring not been used within the 

military? The answer to this is apparently two-part: 

(1) it has been impractical, and 

(2) there seems to be an almost universal disdain for 
dealing with numbers. 

The impracticality was a result of the myriad of arithmetic 
manipulations required to execute this on a continuing basis for the 
entire officer corps. {n short, the needed effort would have been 
staggering. No longer is this true. The increasing availability of 
electronic computers has reduced the impracticability, even the 
mechanical difficulty, of the project to easily manageable pro- 
portions. 

As for the use of numbers, there is much to be said pro and 
con. Proponents of each frequently reflect less-than-maximum 
professional maturity. Carl Heyel seems to have well presented 
both arguments in achieving an appropriate answer to the predica- 
ment: 

‘Sound management never gambles--it takes calculated 

risks.' Thus the president of a far-flung consumer 

products company reset the tone when an enthusiastic 

Sales manager began urging a ''gamble'' on a new pro- 

duct. Yet in the next breath, reverting to a some- 

what academic presentation...he (the manager) commented, 

'That's a good backdrop picture, but let's remember 

that we can't run this business on statistics."' 

By steering between the two extremes, this executive 

was demonstrating the canny judgment and intuitive 

feel that are such a large part of successful manage- 


ment. His words apply with special force to that 
important and often perplexing phase of every manager's 
job--sizing up the present ‘performance and potential 
worth of department heads and other executives re- 
porting to him. 





A great deal of work has been done by researchers 
- ,concerned with what makes individuals and groups 


4] 





tick, and with ways to measure the results of what 
people do... 


The obvious need is to arrive at the proper degree 

of appraisal, utilizing the fruits of psychological 

and human relations research and taking full advantage 

of professional aids... 

The use of the computer and standard scoring of fitness 
reports will be considered in Chapter IV. Meanwhile, let us 
turn to some considerations of the rater. 

The Rater Education Aspect 

Universally, it seems, the problems of rating systems are 
directly traceable to the raters. Three areas of concern immediately 
arise when consideration of the rater is undertaken: 

(1) Feedback to the rater. How does a marker compare 
his ratings with those of other markers? 

(2) What of the rating by one officer? The discussion 
of this and feedback will be found in Chapter V. 

(3) Streaining of the eater ee 

Training of the oie: has long been a favorite subject of the 
writers. Early in performance appraisal development, it was not un- 
common for an organization to give long and serious thought to the 
rating scale while ignoring the education of those who were to do 
the reporting. Is this like building an airplane without training 
bes Fomloc? 

Is it possible that a well-trained group of raters might do a 
fairly good job with an awkward and poorly designed scale while the 
best of scales may give disastrous results in the hands of poorly 
prepared raters? 


carl Heyel, Appraising Executive Performance, (New York: 
American Management Association, 1958), p. 13. 
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In their prolific writings, it is not always true that authors 
agree upon the particularities of performance appraisal. In 
writings, one matter, though, stands out as a universal require- 
ment for rating systems: the need for training the rater. In 
this, some become almost adamant. 

How well the following quote seems to fit into the con- 
Straints which this analysis has accepted: 


'A merit rating program must include specific plans 

and procedures for training the raters. In my opinion, 
lack of training of raters is the most usual source of 
weakness in rating programs. | am not nearly so con- 
cerned about the type of rating form to use as | am 
about the training of raters in use of the form adopted. 
The feeling is all too prevalent that the way to obtain 
better ratings is to get a better rating form. It is 
not surprising that this feeling is common, for if a 
tool doesn't work it is natural to look for a deficiency 
in the tool rather than for a fault in the user of the 
tool. Nevertheless, | believe that if all raters were 
properly trained, almost any rating form would give 
reasonably good results...'' 6 


The directions for the preparation of the Marine Corps 
officer fitness report are clear and well deed Yet, no- 
where could the authors find a record of any formal education of 
Marine Corps officers in the technical aspects of personnel 
evaluation. Certainly, they are exposed to professional leadership 
courses, but presumably few marking officers have had any formal 
Introduction to the idiosyncracies of ''halo'', ''central tendency", 
Peevenicney problems, for example. 

Is it significant that such formal education cannot be Found? 
Heyel cautions about ''putting too much faith in laymen's probings 


Sia Bittner, ''Developing an Employee Merit Rating Pro- 
cedure,'' in Edwin A. Fleishman (ed.), Studies in Personnel and In- 
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dustrial Psychology, (Homewood, I]llinois: The Dorsey Press, Inc., 
1961), p05. 


My. S. Marine Corps, loc. cit. 
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into personality and temperament...'' And this is not to 

suggest that the marking officer is a layman’ in the sense of the 
promiscuous usage of the word; rather, it is to incite this 
thought; ''Has the system done all it can do to bring the raters 

to an appropriate level of understanding of their marking system?'' 

Is it something of an irony that no training has attacked 
this possible weakness? 

Returning to the airplane analogy, not one man has been 
permitted to fly without training. Neither the interests of the 
Marine Corps nor the welfare of the man would voce such in- 
consideration. Yet, can the same be said of fitness reporting? 
Or, is the interest of the Marine Corps and the welfare of its 
men constantly placed in the hands of essentially untrained marking 
officers? 

If so, and if there is a need for training, the big question, 
"How?"', appears. It seems that our attention in this area might 
be directed to three fronts: 

a. Personnel evaluation and allied subjects could be 
included in Marine Corps formal schools curricula. Specifically, 
the curricula of the Basic School, the Amphibious Warfare School, 
and the Command and General Staff School at Marine Corps Schools, 
Quantico, Virginia, could have ''personnel evaluation'' as a part of 
their scheduling. 

b. The ''field'' frequently falls prey to misbeliefs 
about the policies and desires of Headquarters with regard to 


personnel evaluation procedures. This is, by the way, not to 


18 


Heyel, loc. cit. 


Ly 





+ SEES 


justify what occurs; this is to identify that it does occur. 
Examples of this might be ‘'the correction of imbalance between 
aviators and ground officers 9 or the "policy of marking on the 
line between discriminatory blocks on the fitness report .''29 

It may be that a Headquarters representative (possibly a member 

of the Inspector General's team) could keep the ''field!' current 

by formal presentation to marking officers of a command during 
normal duty visits to the respective installations. 

c. Persennel evaluation cerrespendance ceurses could be 
prepared by the Extension School, Marine Corps Schools, Quantico, 
Virginia. Those officers who are not afforded the opportunity for 
formal schooling at the Schools CUPS specified time limits might 
be required to participate in these correspohdence courses. In 
fact, it might be a requirement that cers participate in one way 


Or another at least once every five years. 


All education could be updated on a continuing basis. Tf. | 


Omé. may iwondar what might betincluced in:theteducation '&d be t e 


offferete:, At least these items: & t  e@ ibem:s 
a. History of military personne! evaluation with 
emphasis upon recent history. 


b. History of civilian personnel evaluation. 


I this refers to: Lieutenant Colonel W. L. Traynor (ed.), 
"'Duty...Equally Well Performed,'' Marine Corps Gazette, XLVII 
(January, 1963), 2. That article states in part: ''November's 
discussion here of Major to LtCol selection results has a major -” 
faux pas. This was implication that Selection Board in some way 
tried to equalize assumed 'imbalance' of NA (Naval Aviators) types 
vs ground. That just isn't so. You can get a good argument on 
whether there really is such an imbalance...'! 


201 jeutenant Colonel W. L. Traynor (ed.), ''Fitness Report 
Change,'' Mérine Corps Gazette, XLVII (September, 1963), 2. 





c. A survey of personnel appraisal techniques to 
include study of forms and rating scales or devices. 

d. Standard scoring of fitness reports. 

e. The quantification of those things which can be 
quantified. 

f. Use and evaluation of Marine Corps fitness reports. 

g. Feedback and its meaning (subcourse to use data cur- 


rently extracted from the system). 
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CHAPTER It 
CURRENT USE OF THE FITNESS REPORT 
fies Fil tmess) Report 

What is the fitness report? Section 15068 of the Marine 
Corps Personnel Manual | begins 

Fitness reports form one of the most important records 

of an individual's performance of duty and the professional 

qualifications attained. These reports present a con- 

tinuous record of the individual's service with the Marine 

Corps. Fitness reports are vital in determining assign- 

ment to duty and in selection for promotion. 

Such an introduction certainly does not exaggerate the 
importance of the fitness report for it is the lifeline of every 
professional. If the reports fail to convey the favorable im- 
pressions required by the promotion board then the career simply 
terminates. 

The reference goes on to state ''Each completed report must be 
an accurate and comprehensive portrayal of the individual reported 
Oni,” 

Reports are required on each officer semiannually (and on 
other specified occasions). Completed fitness reports are not 
shown to the officer reported on unless the report is adverse. 
Marginal, adverse and outstanding reports require special attention 
and handling. The reference assigns responsibilities for prepar- 
ation, submission, and review of the report. It provides brief 


definitions for the adjectives heading each marking column (see 


pages 17 and 18, for the report form) and cautions, ''the reporting 


ni S. Marine Corps, Marine Corps Personnel Manual, Officer 


and Noncommissioned Officer Fitness Reports, May 1964, Chapter 15, 
paragraph 15068. 
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senior should consider carefully the italicized definitions 
listed in section c of the fitness report. !'* 

Once completed, the fitness report is reviewed by appropriate 
authority and forwarded to Headquarters Matttne Corps where it is 
further processed and held for future use by the assignment branch 
and promotion boards. 

Assignment to Duty 

The officer being reported on indicates on the report his 
"pnreference fg next espa” The preference, as indicated 
in the reference, is used at'ffeadquarters Marine Corps ''For the 
assignment and transfer of individuais according to the needs of 
the pemice tt 

The part that the fitness report plays in providing guidance 
to the detail section in assignment of officers is not the main 
interest of the paper and will not be pursued at length. However, 
it is important to make the point that individuals are transferred 
and assigned ''according to the needs of the service,'' and once 
assigned to a task, are expected to discharge any and all responsi- 
bilities associated with the task as best able, regardiess of 
apparent relative importance or insignificance. Because of this 
relationship it would seem an individual should receive as much 


credit for a good performance as a club manager cr administrative 


officer as for a gcod performance as an operations officer or platoon 


commander. 
2ibid. Paragraph 15068.5. f(3) 
ibid Paragraph 15068.5.d(8) 
4 bid 
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Selection for Promotion 

Once those administratively eligible to be considered for 
promotion have been identified, their fitness reports and other 
pertinent records are sorted and organized for presentation to the 
promotion board. The board is briefed by staff members of the 
Personnel Department, and presented the board precept in which the 
rules and regulations for the conduct of the board are laid down .? 
The board is then ready to begin a difficult task. 

Precepts may vary from year to year in keeping with changing 
policies and conditions, boards may vary or originate methods of 
selecting the best nuainien but as has been necessary since the 
time this organization grew too large for each officer to know the 
other, fitness reports create the image of the officer being con- 
sidered by the board. 

One of the aids used by the promotion board is the Master 
Brief Sheet (NAVMC HO 466PD) shown in Figure 14, page 50. The 
upper portion of the sheet contains identifying information and some 
pertinent historical data. The lower portion of the sheet contains 
information extracted from individual fitness reports received by the 
officer being considered by the board. This information, arranged in 
columnar form, displays compactly, the command “ants which the duty 
was performed, the duty assignment, the officer's rank at the time 
of the report, the date and length of the reporting period, the 
reason for the report (type report) and marks assigned for Regular 
Duties (section l6a of the fitness report), General Value to Service 


>Lieutenant Colonel W. L. Traynor (ed.), ''How Do Boards Work?"', 
Marine Corps Gazette, XLVIII (April, 1964), 5. 
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(section 19a) and Desirability (section 18). The section of the 


sheet containing marks is shown in Figure 15. 
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Figure | 

The Master Brief Sheet allows a rapid comparison of marks 
assigned to an individual over a period of time. 

Or does it? 

The format of the sheet is well suited for comparison of the 
ratings, but what of the marks in the columns? 

Scanning down the columns in Figure 15, one could certainly be 
led to believe that the officer receiving those marks was becoming 
less and less productive; however, if the period covered by the first 
ten months happened to be 1958 and early 1959, one would have to re- 
call that in 1959 the effort made to re-align marking seencdards: 
resulted in a significant lowering of marks awarded. A mental note 
Or a comment in the margin should be made to remind us of the possible 


influence changing standards may have had on the marks subsequent to 


mid=1959. 


Lieutenant Colonel W. L. Traynor (ed.), ''Fitness Reporting," 
Marine Corps Gazette, XLIV (March, 1960), 3. 
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One might wonder if a change in reporting seniors caused 
the apparent lowering of proficiency. Whether or not reporting 
seniors had changed could easily be determined by a quick reference 
to the original fitness report, but the relative leniency of the 
new reporting senior could not be so easily established. 

Rather than pursue this course further let us attempt to 
project ourselves into the position of having to decide upon the 
best qualified of two contemporaries. We will refer to them as § 
and T. A summary of their marks over the same forty month period 
is shown in Figure 16. The format is that of the Master Briefing 


Sheet. 


OFFICER S OFFICER T 
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For simplicity we are considering the marks on a single 
trait, assuming that marks on other traits have offered no dis- 
crimination between the two individuals. 

We might begin our analysis by counting the marks tn each 
column. S has two Os, outstanding marks; five Es, excellent; 
three AAs, above average; three As, average; and one BA, below 
average. 

T has no outstanding marks, four excellent, ues elena 
average, three average and one below average marks. 

In comparing the sums, we see each has the same number of 
below average, average, and above average marks. S has one more 
excellent mark than T and two outstanding marks where T has none. 

Contemporary S looks like a strong contender. We might 
wander if either T or S enjoyed the good fortune of serving with 
a more lenient marking senior than the other. Compensating for a 
marking senior's leniency or harshness is difficult at best so we 
will assume for our purposes that the various officers marking 
reports of Sf and S are equally lenient and using the same inter- 
pretation of each of the marking adjectives. 

S still seems to hold an edge over T. 

If T and S were being considered for promotion we might be 
interested in knowing whether their performance had improved as 
they matured during the forty months covered by the fitness reports. 
How can we measure improvement? If the marks for the first fourteen 
months had been awarded in 1958 and early 1959, prior to ''putting the 


Squeeze on officers fitness reports ,!'/ would it be meaningful to 


Ibid. 
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compare the marks with those received later in the period? Not 
according to Erenbaere who states 

Differences in raw scores do not ordinarily present 

"'true'' distances. The only way one can meaningfully 

talk about equal differences is to bring in some practi- 

cal criterion which provides a standard value. 

lf we can't compare the marks directly then perhaps we 
should, as we did earlier, make a mental note to compensate for 
the differences in standards when we look for an indication of 
relative performance over a period of time. An even more diffi- 
cult mental gyration would be the one required to consistently 
equate or compare marks over a period of time if marking 
adjectives were changed or replaced by numbers. 

Getting back to our problem. It would, perhaps, be best 
to formalize our recognition of a change in the standards by 
weighting or adjusting marks of the different periods. Such a 
step, though certainly helpful in relating the relative performances, 
will add to the number of variables we must consider in our evaluation. 
Agreeing that we should make an adjustment which will allow compari- 
sons of the marks of different periods we can leave the problem of 
''How?'' to Chapter 4 and look for other differences in the marks of T 
and § that will help us in our selection. 

Notice that S has 14 marks while T has 11. Should each report 
be considered equally? Probably not. Other things being equal, 
a mark of excellent awarded after six months of daily observation 
should be a more reliable evaluation than a mark awarded after one 
or two months of observation, especially if the observations were in- 
frequent during the shorter periods. I!f we decide to weight the 
length and frequency of observation of fitness reports as well as 


Slee J. Cronback, Essentials of Psychological Testing (New York: 
Harper and Brothers, 1960), p. 71. 
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adjusting for standards that change from period to period we're 
developing a fair-sized problem even for handling the simple 


evaluation of T and S. 

Contemplate the magnitude of a promotion board's task where 
all traits of hundreds of officers over a period of six or eight 
(or more) years must be considered. 

In this case we are considering a single trait for each of 
the officers T and S. If we were to consider other traits in 
relation to one another, for instance, compare a mark of 
"excellent'' in ''Regular Duties'' to a mark of ''average'' in ''General 
Value to Service,'' we might be wasting our time. Cronbach? 
illustrates the point 


Willie brings home a report showing that his average in 
arithmetic is 75, and his average in spelling is 90. 

His parents can be counted on to praise the latter and 
disapprove the former. Willie might quite properly 
protest, ''But you should see what the other kids get in 
arithmetic. Lots of them get 60 and 65.'' The parents, 
who know a good grade when they see one, refuse to be 
sidetracked by such irrelevance. But what do Willie's 
grades mean? It might appear that he has mastered three- 
fourths of the course work in arithmetic, and nine-tenths 
in spelling. But Willie objects to that, too. ''l learned 
all my combinations, but he doesn't ask much about those. 
The tests are full of word problems, and we only studied 
them a little.'' Willie evidently gets 75 percent of the 
questions asked, but since the questions may be easy or 
hard, the percentage itself is meaningless. We cannot 
compare Willte with his sister Sue, whose teacher in 
another grade gives much easier tests so that Sue brings 
home a proud 88 in arithmetic. It could be, too, that 
Willie's shining 90 in spelling is misleading, if the 
spelling tests deal with the very words assigned for study. 
A raw score ... , taken by itself, has no significance. 

It can be interpreted only by comparing it to some standard. 


If we are convinced that standards for marking vary over a 


period of time, that consideration should be given for different 


Jcronbach, OO. Git. Peer Or 
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lengths and frequencies of observation, and that different 
traits cannot be directly compared we must make some judgements 


and some calculations before finalizing our preference between 


T and S. 
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CHAPTER IV 
STANDARD SCORES 

Need for Adjustments 

The preceding chapters suggest that ratings may be un- 
desirably influenced by the varying leniency of individual 
marking seniors, by changing of standards over a period of 
time and by use of different standards in different organi- 
zations. To determine whether there are differences in the 
rating of personnel some analysis iS necessary. Graphs 
similar to those in Figure 10, pages 30 through 33, and tables 
like Table Il, page 29, are helpful in illustrating the dif- 
ferences. (For more on differences see Scott. |) Where it 1s 
found that ratings do differ significantly for personnel of 
different organizations (compare graphs of ''Captain-Division!'! 
and ''Captain-Air Wing,'' Figure 10) there are two possible 
explanations. One, it is possible that the differences are 
real differences and members of one organization are actually 
better than those of another. Two, the ratings may have been 
affected by one or more of the objectionable influences mentioned 
earlier, and the differences are functions of these influences 
rather than indications of difference in performance. These 
differences are of little consequence if the ratings are to be 
used only within the context of the group. If, however, the 
ratings are to be compared with ratings of individuals in other 
Organizations it is pertinent to judge whether the differences 

lw. D. Scott, R. C. Clothier and S. B. Mathewson, Personnel 
Management Principles, Practices, and Point of View (New: York and 
London: McGraw-Hill Book Co., Inc., 1939), pp. 199-203. 
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are real or not. If it is determined that the differences are 
not real differences the ratings should not be compared across 


rating groups unless they are adtusted for the differences. 


f 


Yhere are several techniques that can be used to adjust, or 


3 


"translate,''” ratings from different organizations onto a common 


scale. Some methods that have been applied are: 

a, Percentile ranks, 

b. Decile ranks, 

c. 2Z score, 

d. fT score, 

@e. Stanine Scale, and 

f. Forced diceriouclcnme 
The method presented in this study is the standard score based on 
the mean and standard deviation. 
Standard Scores 

99.73% of a normal population lies within three standard 

deviations of the mean (see page 23). This relationship exists 
for a normal distribution whatever its standard deviation. As 
explained by Tiffin’ 


Thus, regardless of what the mean of a distribution is, 
or what the magnitude of its distribution, it is pos- 
sible to express the deviation of any given numerical 
value in terms cf the number of standard deviation units 
it is above or below the mean. 


tbid. 


4 ibid. 


2Frank S. Freeman, Theory and Practice of Psychological Testing, 
(New York: Holt, Rinehart and Winston, 1962), pp. 120-130. 


Ori ffin, op. cit., p. 236. 


58 





Expressing the value of a score in units away from the 
mean is locating the score relative to other scores in that 
population. When the unit of measure is the standard deviation 
we know that a certain percentage of the population falls within 
a designated number of units. That is, 68.27% (Figure 6, page 23) 
of the population will lie within one standard deviation of the 


mean whatever the mean or the value of the standard deviation, etc. 


Population A sooth B 
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Comparison of Scores on a Standard Scale 
Figure 17 

Figure 17 illustrates how two normal distributions with different 
means and standard deviations can be compared. The scale on which 
they are compared will be called the Bere Pee scale. Referring to 
Figure 17, population A has a mean of 92 and a standard deviation of 
2, population B has a mean of 96 and a standard deviation of 1, 
the standard population measured over the standard scale is to 
have a mean of 70 and a standard deviation of 10 (The parameters 


for the standard scale are arbitrarily chosen). Assuming that 


ay, 





populations A and B are similar, that is, have equal talent (or 
whatever is being measured to cause the distributions graphed in 
Figure 17) we can equate a score of 92 in population A to a 96 

in population B and both are equal to a standard score of 70. 
Other scores can be visually compared by tracing the lines con- 
necting comparable points on each scale. In the illustration, the 
lines connect only those points at whole standard deviation units 
from the mean. Discrimination can be further refined by using i 
fractional multiples of the standard deviation. 

Note that a score of 96 is meaningless unless we know to 
which population it belongs or on which scale it is measured. 
Populations A and B cannot be directly compared, but when ''tran- 
slated'' to a standard score by use of the means and standard 
deviations they can be appropriately equated. 

Various methods for computation of mean and standard 
deviation are well documented in texts.’ The mean is computed 
by summing the various scores and dividing the sum by the total 
number of scores considered. Once the mean is known, the standard 
deviation can be computed. The appearance of the formula ''makes 
it difficult to see just what the standard deviation means, but 
in effect, it is an average of the deviations of person's scores 
from the group ris The standard deviation can be computed 


S, 


using the following equation: 


/Taro Yamane, Statistics, An Introductory Analysis, (New York, 
Evanston, and London: Harper and Row, 1964), pp. 35-74. 


Slee J. Cronback, Essentials of Psychological Testing, (New 
York: Harper and Brothers, 1960), p. 80. 


; Fvamane, op. Gli Ape or 
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Standard Deviation = 





where X; is the if score, 


X% is the mean score, 
and n is the total number of scores considered. 
Though neither computation is complicated, both require con- 


siderable time if accomplished without the aid of an electronic 


(a3 


tf 
computer. 


ASD Ueeepp lies sto UF LinessmReporszs 

One might wonder how standard scoring can be applied to a 
rating scaie that uses words rather than numbers to discriminate 
between levels of performance. !n particular, how can we use 
een scoring with the Marine Corps Fitness Report? 

Recall the discussion in Chapter, page 22, concerning the 
expectatiams of psychologists that most human traits have distri- 
butions approximating the normal distribution. Let us assume that 
psychologists have convinced us that the abilities of Marines to 
perform duties should approximate a normal aie tion and should 
so reflect in fitness report markings. Further, let us assume 
we want to use the rating adjectives that are used in the current 
fitness report. The adjectives themselves may not be particularly 
well chosen for this use, as demonstrated on page 28, but the six 
graduations from ''unsatisfactory'' to ''outstanding'' can be used 
handily to represent the six standard deviations about the mean 
that encompass 99.7% of the normal population. 

Redrawing Figure 8 and adding a numerical scale produces 


QP, 


Figure 18. 
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A Numerical Scale Associated with the Distribution 
of a Normal Population 


Figure 18 

The mean for the adjective scale lies between the ''average'' 
and ''above average'' marks. By assigning a mean of 70 and a 
Standard deviation of 10 to the numerical scale, the six adjective 
discriminations (and so 99.73% of the population) are included in 
the scale from 40 through 100. 

A problem becomes apparent. The numerical scale can be sub- 
divided into many discriminations by measuring fractional values 
of the standard deviation. The best we can do with our six 
adjectives is to associate a single value to each. By assigning 
to each adjective the value that falls midway between the limits 
of the discrimination, we have an average score representing all 
the possible scores within a particular standard deviation. About 
34.1% of the marks should be ''above average,'' with a corresponding 
score of 75; 13.6% marks of "'excellent,'' with scores of 85, etc. 
Table II11 shows the assignment of numerical values to the 


evaluation adjectives. 
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NUMERICAL VALUES OF MARKING ADJECTIVES 
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With numerical values assigned to each rating, it is possible 
to compute a mean ard standard deviation for the distribution. 
Having the means and standard deviations of several groups, we are 
then able to compare the individual's scores in each group as in 
Fifgmre |7. 

This technique might be used to compare the fitness reports 
awarded prior to 1958 to those awarded after 1958 by determining 
the means and standard deviations for each trait for each marking 
period, converting to standard scores, and comparing. 

Let's return to contemporaries S and T discussed in earlier 
paragraphs. When we compared the number of marks each received 
in the varicus marking categories, S had one more mark of 
excellent and two more of outstanding than did 7. If we simply 
count the marks in each category and compare the totals, S will, 
in effect, be receiving credit for more work than fT. That is, S 
has received 14 payments (fitness reports) and T only 11. 
Further, simple summing as above, can award the same payment for 
One month of cutstanding work as fer 5 months. An individual 
rated ''unsatisfactory'' for five months and ''outstanding'' for one 
month, has the same over-ail score as one with five months of 
outstanding’! and one of "unsatisfactory.'' Certainly the two 
records are not equal. 


63 





We should recognize that an unsatisfactory report would 
result in special actions and not likely be compared as mentioned. 
However, the same analogy can be made with ''above average'' and 
"outstanding'' marks, or whichever ratings one desires to compare. 
The point to be made is that the comparing of numbers of marks in 
each column does not necessarily compare performance. It is 
essential to consider the duration covered by the mark as well 
as the mark itself. 

We mentioned in the previous section that a marking senior 
would likely have a better opportunity to observe an officer 
during a six months period than during shorter periods. This 
consideration strengthens the argument in favor of increasing 
the influence of reports covering longer periods. 

If we are convinced that time should be considered when 
evaluating reports, we are faced with the problem, ''How?!! 

Informal procedures and arbitrary assignment of weighting 
factors aren't reliable enough where so much is at stake. What- 
ever weights are assigned should be a matter of record so that 
application its consistent, control is maintained, and changes 
can be made if it is felt that the relative importance changes. 

To assign a weight to an adjective has little meaning - the scores 
must be quantified before weights are assigned. It is not neces- 
Sary that the marking officer assign a number for a grade. The 
assignment of numbers can be accomplished at Headquarters. As 
mentioned earlier, the numerical value assigned a rating adjective 
iS a value judgement made as policy; there is no magic number. For 
the purpose of this paper we will assign values as shown in 


Table Ill. 
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The relative weights assigned to reports covering periods 
of different lengths are also value judgements and should be 
established by policy. Once established they can be changed 
as the feeling towards their relative importance changes. To 
make the problem simple for ourselves, let us make the weight of 
a report equal to the number of months covered by the report. 
This arrangement makes a two month report twice as influential 
aS a one month report, a six month report three times as in- 
fluential as a two month report, etc. To illustrate the use of 
the weights we shall compute the mean score for threezreports of 


varying lengths as shown in Figure 19. 





Case | 
No. of Months 
Grade and Weight Product 
80 6 6x 80 = 480 
80 2 2x80 = 160 
80 mise lex-ooee— 80 
9 720 
Weighted Average = os = 80 
Case 2 
No. of Months 
Grade and Weight Product 
70 6 420 
80 2 160 
90 afi: 90 
9 670 
Weighted Average = = = 74,4 


Computation of Weighted Average 


Figure 19 
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Where the scores of T and §$ (see Figure 16, page 52) are 
weighted and averaged, as in the preceding paragraphs the results 


are as shown in Figure 20. 


Officer S 

Grade Months Product 
Zo 2 190 
75 4 300 
85 5 425 
95 | he 
85 | 85 
75 5 375 
65 6 390 
15 l fas 
65 4 260 
85 | 85 
55 6 330 
85 2 170 
65 3 195 
85 ra 85 

40 3060 

Weighted Average = 3060 = 76.5 
40 
Officer T 

Grade Months Product 
65 2 130 
75 a 300 
85 6 360 
65 2 130 
55 oy, 
75 3 225 
85 6 510 
85 6 510 
65 l 65 
75 P, BIS: 
85 oom 510 

40 3170 


Weighted Average = 2 my os es 


Computation of Weighted Averages for Officers S and T 


Figure 20 





The results of the weighted averages indicate T has a 
more favorable record than S. This is a reverse from what 
earlier considerations led us to suspect. 

Analyzing the marks by months of performance at each level 
produces results that agree with that of the weighted average. 
Table !V indicates the number of months the contemporaries T 
and S received each of the various markings. 

TABLE IV 
MONTHS OF PERFORMANCE AT EACH RATING 


Number of Months 


URS ea ee a eae) 


13 10 10 5 
5 12 24 - 


The excellent rating dramatically illustrates the importance 








Contemporary 
S 


r 


of weighting reports according to time. When we counted the 
various number of excellent ratings each received, S had one more 
than T, and appeared stronger at that level; but looking at the 
length of period covered, we find that T received a mark of 
excellent for twenty-four months of the period and S only ten 
months, a multiple of almost two and one-half in T's favor. 

We should remember at this point that weighting of marks is 
valid only if the marks are from the same scale. This means, of 
course, that prior to using the weights, the marks on the reports 
must be converted to a standard scale. 

A few years ago, computation of this type for a group the size 
we are considering, would have been prohibitive. Today the elec- 


tronic computer can do the job with relative ease. (Appendix A 
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describes a computer program executed utilizing ficticious 
fitness report marks.) 

At this point, one might question the interpretation of a 
score of 76.5 or 79.2 when no such scores were available on the 
input scale. Or, a related question, is 79.2 a higher ''above 
average!’ mark than 76.5? Such questions can be partially 
answered by asking if two ''excellent'' and one ''outstanding!! 
reports result in a better average rating than three ''excellent'' 
reports for the same period. The answer is yes, of course, other 
things being equal. 

The averages 76.5 and 79.2 are simply the relative standings 
of T and S based on the marks awarded by their seniors and the 
relative importance placed on observation time by established 
policy. This type of placement is not unlike the placement 
derived by comparing varying combinations of ''average,'' ''excel- 
lent,'' ''above average,'' etc. What is gained by using formally- 
adopted weights and mathematical computation Is a system more 
precisely responsive to values (weights) declared appropriate in 
directives, a reduction in the amount of subjective adjustment, 
and a capability of accurately reflecting the effects of varying 
weights assigned to variables. 

Earlier we mentioned that a report completed during a period 
of close observation should be..a more accurate appraisal than a 
report completed for a similar period if observations of the 
reportee by the reporting senior were infrequent. Adjusting for 
frequency of observation can be accomplished in a manner similar 
to that described for weighting the duration of a report. Weights 


swoutd be assigned to each of the three categories of observation 


68 





marked in Section I15A of the fitness report. The weights, assigned 
by directive, would reflect the current feeling of their relative 
importance. We might remind ourselves that these weights would 

not be assigned by the marking officer on the fitness report. 

In fact, it would not be necessary, or even desirable, that the 
marking officer be aware of the weights. All computations should 
be made at a central point to ensure consistency, and avoid 
duplication. 

As an example of how the consideration of both duration and 
frequency of observation would effect the appearance of a weighted 
average, let us set up an example. We can arbitrarily assign 
numerical values to each degree of observation for our example. 


Let us assign weights as follows: 


Weight Category 
3 Daily contact and close observation 
2 Frequent observation 
] Infrequent observation 


A sample computation using the above weights and the weights 
previously assigned for the duration of observation is shown in 


Blgtires 2 le 
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No. Months 


and Freq. of Observation Composite 
Grade Weight Freq. Weight Weight Product 
80 6 Daily 3 6x3= 18 1440 
80 2 Infreq. l 2x1l= 2 160 
80 l Freq. 2 bx 2 ee 160 
22 1760 
Weighted Average 1760 - go 
22 
No. Months 
and Freq. of Observation Composite 
Grade Weight Freq. Weight Weight Product 
70 6 Daily 3 6x 3= 18 1260 
80 Z Infreq. ] 2x1l= 2 160 
90 Freq. 2 [rz 2 180 
22 1600 
Weighted Average 1090 = 72.7 





Weighted Average Considering Duration of 
Report and Frequency of Observation 


Figure 2] 

lt has been well established that the degree of leniency 
varies between marking officers. Adjusting of fitness reports to 
compensate for individual peculiarities is worth some consideration. 
Assuming that an unusually high or low rating of a group ts the 
result of a marking officer's tendency rather than an indication 
of exceptional performance, fitness reports prepared by different 
marking officers can be converted to a standard scale and compared. 
If however, the marks represent a real difference and the personnel 
of one group are better than the other, then a conversion is not 
appropriate. There are some groups, perhaps the Basic School 
Staff or a special task section, that are particularly good. To 
insist that the marking officer for such a group award a mark of 
"average'' to an officer for an ''excellent'' performance because 
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that officer is a member of an exceptional group is at least 
as bad as awarding an inflated mark to one not deserving. 

[It is relatively easy to allow for a special group by 
raising or lowering the group mean and redistributing the scores 
of the group about the new mean. The major problems in this 
case are; one, identifying the special group; two, establishing 
precisely how much different the group is from the over-all 
population. Once these two judgements are made the standard 
score may be effectively utilized. 

We have mentioned only a few of the traits that are marked 
on a fitness report. Whether, and how the other traits ona 
report should be considered is another study. It is very diffi- 
cult to imagine the problem of mentally evaluating the twenty-two 
marks on each fitness report for each individual of such a large 
group, even without considering weights. Making adjustments 
for the frequency of observation, the particular leniency of 
each reporting officer and the changing of standards makes evalu- 
ation by the mental process slow and difficult at best; sub- 
jective, or arbitrary under less ideal circumstances. The require- 
ment for comparison cannot be eliminated nor should proper weighting 
be avoided. Use of standard scoring and modern computing techni- 
ques can reduce the problem of considering all of the traits (if 
such is desired) to a manageable task. Appendix A presents work- 
able computer programs prepared to compute and print out means, 


Standard deviations, and standardized reports. 
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CHAPTER V 
MORE PROBLEMS AND THE RATER 
What of One Marker? 

After his training, or lack of it, the rater's personality 
seems most to be reflected in the problems of any rating system. 
Leniency of rating, for example, is the most common weakness of 
the systems. Of course, if all raters were equally lenient, the 
inequities would cancel out; comparisons would be made on a com- 
mon scale; and the system would work precisely as it should, the 
inflated ratings having no bearing at all. But, when markers 
display different degrees of leniency, the system, as we have 
seen before, falls apart. 

A first question here seems to be: why does leniency 
occur? How does the personality of the rater enter into the 
effort? Not surprisingly, a great deal of professional energy 
has been expended in attempting to answer those questions. Per- 
haps McGregor strikes close to the heart of the matter with this 
out look: 

The conventional approach (to personnel appraisal), 

unless handled with consummate skill and delicacy, 

constitutes something dangerously close to a violation 

of the integrity of personality. Managers are uncom- 

fortable when they are placed in the position of ''play- 

ing God.'' The respect we hold for inherent value of 

the individual leaves us distressed when we must take 

responsibility for judging the personal worth of a 

fellow man. Yet the conventional approach to the 


appraisal forces us...to make such judgments...No 
wonder we resist. 


\peuglas McGregor, ''An Uneasy Look at Performance Appraisal,'! 
Harvard Business Review, XXXV (May-June, 1957), 90. 
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That's one approach. Other authors are not so lenient 
in appraising the rater's position and the explanation of his 
easy marks. Bass, for instance, quoted Thorndike* and 
Glickman? in Suggesting these motivations of the rater: 


As Thorndike and Glickman have noted about the lenient 
rater: 


1) He may feel that anyone under his jurisdiction 
who is rated unfavorably will reflect poorly on his 
own worthiness. 


2) He may feel that anyone who could have been 
rated unfavorably had already been discharged from 
the organization. 


3) He may feel that a derogatory rating will be 
revealed to the ratee to the detriment of relations 
between the rater and the ratee. 


4) He may rate leniently in order to win pro- 
motions for his men and therefore indirectly increase 
his future control of his subordinates by earning a 
reputation as a superior with ‘influence upstairs. ' 


5) He may be projecting. 


6) He may feel it necessary to always approve 
others in order to gain approval for himself. 


7) He may be operating on the basis: 'Whoever 
associates with me is meritorious; therefore | am 
meritorious.,! 


8) He may rate leniently because there exists 
in our culture a, response set to approve rather 
than disapprove. 
Sometimes, if inflation (or deflation, for that matter) 


exists, it is the result of ''plain old bias.'' [It seems some- 


thing of an understatement to say that this is probably the 


2p. L. Thorndike, Personnel Selection. (New York: John 


Wiley and Sons, Inc., 1941). 


3n, S. Glickman, "Effects of Negatively Skewed Ratings on 
Motivations of the Rated.'' Personnel Psychology, VIII (Spring, 
1955), 3 


Bernard M. Bass, ''Reducing Leniency in Merit Ratings,'' 
Personnel Psychology, IX (Winter, 1956), 369. 
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most word-worn of all the human difficulties in evaluating 
other humans. Typical of the comments in current literature 
1 Seen Ss: 


The bias of the rater may occur in a number of ways-- 
and it may significantly influence ratings. All of us 
have our share of prejudices...some supervisors are 
favorably or unfavorably impressed by employee char- 
acteristics that are not related to job performance 

Or potential growth in an organization. For instance, 
a supervisor may be prejudiced toward workers who hold 
similar religious beliefs and against those who hold 
markedly different ones. Although this Supervisor is 
probably unaware of his bias--he knows only that he 
likes or dislikes a particular employee--it will tend 
to influence his rating under the merit-rating plan.2 


Nor have the military publications maintained a silence 
about the rater problem. Colonel Hovell, USA, makes some strong 


points: 
One common cause of our troubles is an inverted sense 
of values. AS raters, we appear less anxious to do 
justice than to keep our subordinates happy. This is 
evidenced by our tendency to award them high ratings 
which frequently they do not deserve... 


A second cause (of the rating problem) is our short- 
sighted sympathy. We are inclined to protect and 
favor the underdog, particularly when he makes a 
lusty effort. This leads us to submit or approve 
too many glowing reports of mediocrity... 


The main cause of our difficulties, however, is our 
lack of moral courage. Now | do not imply that all 
or most of us are cringing cowards. But all too 
many officers, including some who have proved them- 
selves fearless in combat, shrink from standing up 
staunchly to their rating responsibilities. They 
recognize the faults and limitations of their sub- 
ordinates, but having failed to point out these de- 
ficiencies for correction as they occur, they com- 
pound the injustice by also failing to acknowledge 
these shortcomings when rendering efficiency reports. 


6 


William B. Wolf, The Management of Personnel, (San Francisco: 
Wadsworth Publishing Company, Inc., 1961). p. 231. 


Cpenden Bernove Mie. Collonely shy mOpem che up. 25. 


74 





aA 
* babes 
wile 
a 
é 











In an efifoirt to'iovercome these rater difficulties ° the U. S. 
Army, for example, instigated in their 1961 system the require- 
ment for the endorsing officer to rate the ratee also. Figure l, 
page 5, shows the scheme. In view of the current unrest within 
the Army concerning their reporting problems, it would seem that 
the system has been less effective than desired. 

Civilian substitutes for the single rater exist, too. The 
need and manner are well documented. Hepner says, 

To prevent unfair and erroneous estimates, it is 

necessary to have at least three persons rate each 


employee. No matter how impartial or intelligent 
the rater may be, he is apt to commit serious errors. 


/ 

Committee ratings, as the multiple ratings are sometimes 
identified, have many advantages. The one most frequently cited 
is that ''they bring several viewpoints to bear on the rating and 
offset the immediate supervisor's special Shasck Tiffin, long 
considered expert in industrial relations, supports this with 
''.,.a procedure that increases the accuracy of ratings is the 
conference... .!!7 

And, finally, Hepner in a later work adds some new dimen- 
Sions in saying: 

The committee or group approach to appraisal review 

systems is gaining. The typical executive does not 

want to be the only person to evaluate aman. In 

the committee approach, the group consists of per- 


sonnel specialists and senior executives, including 
the man's immediate supervisor...The committee approach 


Juarry W. Hepner, Psychology Applied to Life and Work, (Engle- 
wood.Cliffs, New Jersey: Prentice-Hall, Inc., 1956), p. 362. 


oeeonae Strauss and Leonard R. Sayles, Personnel: The Human 


Problems of Management, (Englewood Cliffs, New Jersey: Prentice- 
Hall, Inc., SES) Da. 357% 


9 Joseph Tiffin, Industrial Psychology, (Englewood Cliffs, 
New Jersey: Prentice-Hall, Inc., 1952), Dy 35) 
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eliminates tendencies toward personal prejudice. 

ft also takes a great load off the supervisor. 

Instead of saying '! think. . . .' he can now Say 

'We believe. 110 

Theoretically, the committee system seems to offer the 
opportunity for improving some of the defective areas of Marine 
Corps officer evaluation. tmmediately, though, a first counter- 
thought defends the commanding officer's domain. He alone is 
responsible for the success or failure of his unit and, tradition- 
ally, he alone is considered in best position to judge those who 
contribute to its success or fallure. 

But the counter-counter question perslsts: ''What does the 
record show, what has been the success of the system?!! 

To be sure, absolutely no bit of command authority or 
responsibl lity can be denied to the commanding officer, just as 
none is denied at this time. Yet it seems that precedent for a 
group appraisal method of personnel evaluatton is already wel] 
established within the U. S. armed forces, and it is accomplished 
with no loss of command authority or responsibility. The reference 
here is to the system of military justice provided under existing 
federal regulations. 

Daily, boards of evaluation called court-martial$ appraise 
the activities of a limited number of personnel and the worth of 
those individuals for attempted rehabilitation. In this area, 
all matters of such importance as to require confinement beyond 
one month (or similar punishment) of the individual is placed 
before the judgment of a board of officers of the organization 

lOvarry W. Hepner, Perceptive Management and Supervision, 


(Englewood Cliffs, New Jersey: Prentice-Hall, 1961), p. 329. 
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under the full command authority and responsibility of the 
unit's commanding officer. This is as opposed to being placed 
before the commanding officer himself. 

Does it not seem ironical that this short term welfare (one 
month) of the Marine Corps and of its worst malcontent is pro- 
tected by the jury system while the eternal welfare of the Marine 
Corps and the eternal welfare of a vast number of its productive 
citizens are placed in the hands of essentially the single marker, 
the natural vagaries of whom have been recognized and substantiated 
for years? 

Is there anything to be gained by having a ''Board of Evalu- 
ation'' as opposed to having a ''Reporting Officer?'' tf so, how 
might such a Board be administered? 

If the details and advantages of such a system seem vague, 
then let us build an example using the chain of command in the 
reporting scheme discussed in Figure 11, page 35. 

The scenario might again find Lieutenant A and his con- 
temporaries approaching the end of a reporting period and their 
records in need of fitness report submission. The responsibility 
and command authority for the preparation of those reports yet 
remains with the battalion commander, LtCAA. Now, however, as 
Opposed to awaiting a ''rough'' report, a product of the somewhat 
myopic outlook of Capt A, LtCAA convenes the battalion Board of 
Evaluation and awaits its formal report. 

The battalion Board of Evaluation, in this case, might be 
composed of the battalion executive officer, Major A (MaA), who 
has frequently observed Lieutenant A in roles as, among other 
things, Investigating Officer, Battalion Duty Officer, and counsel 
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in special court-martials. {t includes Major B, the battalion 
$-3, who has frequently used Lieutenant A in role as battalion 
Range Safety Officer and who has frequently observed the Lieutenant 
as an instructor in battalion classes and training exercises. 

All of the company commanders are on the Board, including 
Capt B who has frequently seen Lieutenant A in tactical exercises 
when Lieutenant A's platoon tied-in on Company B's flank. Capt C 
is there, too, and he well remembers the performance that Lieute- 
nant A recently gave with him on a battalion board of survey. 
Capt D was Regimental Duty Officer one night when Lieutenant A 
was Officer of the Day; how well Capt D remembers how Lieutenant 
A had handled a pretty nasty affair at the Service Club that 
nalight . 

The example might be extended indefinitely. The point 
would be the same: the relevant information which could be 
assembled concerning the performance of Lieutenant A would be 
far greater than that which Capt A will present the Board con- 
cerning the Lieutenant. The Board will ''bring several viewpoints 
to bear on the rating and offset the immediate supervisor's 
special bias,'' whether he be biased favorably or unfavorably. 

And, as Lieutenant A is discussed, so, too, will all the 
lieutenants of the battalion be discussed and COMPARED. Eventually, 
the Board will arrive at findings upon the appraised worth and 
potential of the lieutenants. [ts formal report will be pre- 
pared and presented to the convening authority. 

As with the findings of a court-martial which he had con- 
vened, LtCAA might have certain options in accepting or rejecting 


the findings of the Board. LtCAA prepares the official report, 
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using the Board's report as a guide. The report submission 
is to the Reviewing Authority, ColAAAA (see Figure 12, page 36) 
as previously. 

The scheme could be perpetuated up through the ranks in 
accomplishing evaluations for all officers and, for that 
matter, down through the ranks in accomplishing the required 
reports for non-commissioned officers. 

Feedback to the Rater 

Chapter IV has set the stage for consideration of a final 
and most important aspect of personnel evaluation. 

Throughout the literature, there has been strong implication, 
that raters find it easy to rationalize the shortcomings of their 
own efforts in terms of what they think other raters are doing. 

We know, too, that it iS not uncommon to hear the comment, 
"everybody gets outstanding marks.'' In fact, the 1959 survey of 
ratings found this comment not too far from being correct. It 
seems reasonable to conclude that some part of high markings 
comes as a result of the individual marking officer not wanting 
to ''hurt'' subordinates by his totally proper evaluation when he 
Suspects others are inflating the marks of his subordinates' con- 
temporaries. 

The important theme, almost entirely, of our work has been 
centered on the thought of making better use of our marking 
officer as a measuring device. To make him better is a difficult 
task at best; but to do so must be virtually impossible when 
marking officers are calibrated on different scales as results 


of their differing experiences. 


We, 





Add to the fact of the marking.officers’ rationalizations, 
the thought that there is no reason to hope that separate 
marking officers will attach the same meaning to phrases like 
"above average captain'' or ''excellent lieutenant.'' The markers 
experiences are different; their standards are different. Yet. 
not such a hope, but such an assumption is the very heart of the 
Marine Corps appraisal system. 

Lieutenant Colonel A. V. Arnold, Jr., USA, has used an 
ingenuous example for better understanding of this problem. 
lt seems worthy of reproduction here. He writes: 


At present the rating task assumes that the ratio 
between any two pairs of assigned scores will be 
equal if the ratio of the performances eliciting 
those scores is equal. In other words, although 

the input and the output may not be related 1:1, 
there will be a consistent predictable relationship. 
This assumption is a fair one and is supported by 
evidence on the capability of man from psychophysics. 
The second assumption of the rating task...is that 
the rater is aware of this personal input:output 
relationship---or bias, if you will---and knows how 
to eliminate it from his ratings... 


Suppose that efficiency were based on height and 
that tape measures and similar instruments did 

not exist, what would a rater do? First, he would 
hold a sizing formation in which the rated officers 
are aligned by height. Then he would try to estab- 
lish some proportion by which the tallest officer 
was taller than the next one and so on and then 
assign appropriate absolute numerical values. 
Second, he would establish the average or mean 
height of the officers rated and then look around 
at what other raters are doing in an attempt to 

peg the average to a common standard. 


The analogy oversimplifies the problem, but | 

maintain that the rater, if he is to report his 
perception accurately, must make such a simpli- 
fication internally. Magnitude estimation is man's 
most accurate and surprisingly reliable mode of 
sensory discrimination. Yhe rater must be en- 
couraged to establish an internal ratio scale with his 
Own units and, after his judgment is completed, to 
transform it to the standard scale. By ratio 
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scaling he can simplify his judgments and enhance 

their reliability. The point is clear that the 

''look around'' or feedback is vital to elimination 

of rater bias. 

There is definitely a need for some method which the 
marking officer can use to ''calibrate'' rather than to do so 
by speculating what others are doing; he should not have the 
opportunity to rationalize his efforts. 

Probably, the best way that calibration of the marking 
officer could be accOmplished would be to have every rating 
officer mark every officer of some selected group. The results 
of that rating could be tabulated and the tabulations furnished 
to all. Each officer could then have a better understanding of 
how he measures an individual compared to how the group measures 
the individual. 

Best, though it may be, it is obviously out of the question 
to execute a feedback program that way. 

To approach the problem from another angle, wouldn't the 
composite tabulation of all performances establish a standard 
against which the rater could calibrate himself? Could it suggest, 
too, to the reviewing officer some places where more training of 
the marking officers would be required? 

Let us suppose that the Commanding General of the 2nd 
Marine Division were to receive a semi-annual report of officer 
evaluation for his regiments which looked something like that in 
Figure 22, page 83; in this case the report is for those officers 
of grade of captain. For simplicity sake, only the regiments 


have been included in the example. 


Mt i eutenant Colonel A. V. Arnold, Jr., ''Feedback to the 
Rater,'' Army, XV (July, 1964), 54. 
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The example, incidentally, is not intended to be a 
dramatic one; nor is the form displayed necessarily considered 
to be optimum. This is merely one way that feedback might be 
administered in indicating, in routine fashion, one area of 
possible reporting weakness. 

In the example, the information available is sufficient to 
cause some questions. Assume that a mean of 85.00 with standard 
deviation of 4.00 (indicates a range of marks from 73.00 to 
97.00 with 68% falling between 81 and 89) has been established 
the most desirable result. The marks currently used from un- 
Satisfactory thru outstanding have been converted to numerical 
grades to indicate that captains of the Marine Corps are 
receiving slightly higher evaluations (87.50) than those desired. 
This, of itself, is not a problem, since standard scoring will 
bring it into line for comparison of reports with those of other 
reporting periods. 

The captains of the 2nd Marine Division have received just 
about the average grade given to all captains of the Marine Corps. 
Significant information, though, centers about the large 
differences appearing in the average marks of the respective 
regiments. The 2nd regiment has received low marks while the 
8th Regiment has received marks which are unusually high. The 
6th and 10th Regiments have average marks which are generally close 
to those of the Division and of the Marine Corps. 

The question that might occur to the Division staff at this 
time is: do the regiments reflect large differences in performance 
as such marks indicate they might? If so, then likely no further 


action would be considered. If not, it may be that some further 
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Example of Feedback to the Division 





Figure 22 
investigating would indicate where marking weakness could be 
Occurring. 
At the same time that a report like that in Figure 22 might 


be sent to the Division Commander, a report in the nature of — 


Figure 23, page 84, would be sent to the commanding officer of 
the 8th Regiment (and all other Regiments). The information given 


to the commanding officer includes captains' average marks for the 


Marine Corps, the Division, the Regiment, and, in this case, for 


> 


each of the units subordinate to the 8th Regiment. 
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Figure 23 

Immediately, the Regimental Commander could observe that 
captains in his unit had received significantly higher markings 
on the whole than captains of the Division and of the Marine corps. 
His: first reaction would probably be to consider if the captains 
of his regiment really ''stood out'' as this would indicate. Hls 
next reaction would likely be to attempt to find out how the 
different battalion commanders of his regiment had marked their 


groups of captains. \ 


Bly 


The latter information is already in his hands. Reference 
to it shows that the battalion commanders, coincidentally, have 
each marked just above the Marine Corps average at an average 
grade of 88.00. ‘The area to which the Regimental Commander 
would probably look more definitively would be to Headquarters 
Company which shows severely high marks. {t may be that there 
is need for better calibration of the marking officers of Head- 
quarters Company; on the other hand, the captains of that company 
may be truly outstanding and the Regimental Commander would 
determine that the high fitness reports are justified. At any 
rate, a possible area of weakness in marking officers has been 
immediately identified. [t is not unlikely that, given the in- 
formation, the marking officers would correct their calibrations 
for the next marking period. 

The information contained in Figure 23 would also be sent 
to the battalion commanders, generally the last level of officer 
fitness report preparation. Each battalion commander could make 
the same comparisons between what other units have done and what 
he has done in marking effort. And he can do this in terms of 
groups of officers with whom he is personally familiar in most 
cases. 

Certainly, the idea of feedback to the rater is not new. 
Likely, one of the greatest deterrents to using feedback has 
been the inability to cope with the large amount of arithmetic 
manipulation required to achieve it. No longer is that true; 
the computer has reduced that matter to an insignificant one. 

‘9 


And, to conclude in Colonel Arnold's words: 
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Perhaps the reason for lack of rater feedback in our 
system today is the fear that general knowledge of 
the actual distribution of scores would lead to a 
second order inflationary effect. By this | mean 
the raters might keep shifting their ratings to the 
top half of each newly publicized distribution. As 
fearful as it sounds, the resulting scores would 
contain relatively no more error than before. If 

we ignore this fear and set out on a determined pro- 
gram to educate the rater, the other extreme may be 
realized---valid ratings measured on a common ratio 
scale. The rater is the only operator ! can think 
of....who has no way to obtain feedback on the job. 
A very ae first step is needed to educate him in 
his bias. !4 


tearnold, op. cit., p. 58. 
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CHAPTER VI 
SOME CONCLUSIONS 

[f a ship at sea goes aground, is it likely the first 
serious questions would have to do with the vehicle? Or, is 
it more likely the first Ssericus questions investigate the 
ability of the captain and his navigator? If a plane hits a 
mountain peak, which comes first: the thought of failure of 
the vehicle, or the thought of pilot error? 

Personnei evaluation exists in an atmosphere of almost 
constant investigation, or analysis. But for some reason, 
contrary to ships aground and airplanes on mountain peaks, 
almost all questions have to do with, the vehicle---the 
reporting form---and not with the mine (marker) error. 


This study has limited itself essentially to some analys¢s 


which would hope to make a more effective use of the present 
system of officer evaluation; it makes no concession to the 
frequently popular idea that only massive change of current 
report form can cause an improvement to the system. 

The conclusions of this study are embraced in five major 
areas which have been discussed at length in the previous sec- 
tions; asixtharea, the computer, which has appeared throughout 
the discussion; and a seventh matter newly suggested as a 
possibility for further study. 

One particular, too, can be reaffirmed at the outset: the 
ultimate personne! evaluation system is unlikely to ever be a 
practical reality in the near or intermediate future. 

Our system does not, in the end, exist for the purpose of 


making a 'perfect' evaluation of men although that would be a 
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nice by-product. Our system will have achieved adequate re- 
sults if it can accomplish perfect comparison of individuals 
for whom it is designed---ManinerCorps Officens.  o' 

lt would seem that if a change for the better can be made, 
and particularly if it can be made without risk to the current 
standards, then it should be made. 

With the foregoing thoughts in mind, our conclusions to this 
Study are presented. It seems reasonable to hope that their 
Implementation would result in a better comparison of the Marine 
Corps officer group without jeopardy to the standards of com- 
parison now being achieved. 

1. Training 

If there is one area in which the problems of officer 
rating can be improved, it is in enhancing the marking officers' 
knowledge of the technical aspects of personnel evaluation. In 
the chronology of attempted improvements to the system, this 
should be first: training should be instigated. 

lt is important that training be undertaken at all levels. 
If an officer is not afforded the opportunity for such education 
in formal schooling, then he should be required to participate in 
some correspondence training effort. In fact, it should be a 
requirement that officers participate in one way or another at 
least once every five years. 

To implement this suggestion would be to take a ''giant step!'! 
toward elimination of personnel appraisal problems of the Marine 
Corps. The evidence is convincing beyond reasonable doubt, if 
there ever was any, that Marine Corps officers desire to give a 


maximum performance. The performance in personnel appraisal, 
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records show, may be less than maximum---not because the 
markers! desire has failed them, but because knowledge of the 
system, so easily taken for granted, may not have been complete. | 
2. Feedback 

In a Sense, one part of the marker's education is a feedback 
of a composite of what all markers have done in evaluating their 
subordinates. Feedback to the marker should be implemented. 
This is likely one of the first matters which could be accom- 
plished and it is likely to be one of the most productive steps 
that could be taken in efforts toward more realistic evaluation. 

A limited example of the effect of feedback---although other 
variables helped to produce the more appropriate evaluations--- 
is the results achieved after the 1959 survey. Recapitulation, 
or feedback, identified the suspected weakness; marker input 
became significantly more discriminatory after the results of 
the survey became known. 

One way to exploit the desire of Marine Officers to give 
maximum performance is to let him know where his performance 
is less-than-desirable. Feedback is precisely the technique 
which will let the markers know that a less-than-desirable per- 


formance is being perpetrated in personnel evaluation. 


Isee, for example, Lieutenant Colonel W. L. Traynor (ed.), 
"Officer Markings Get Special Attention,'' Marine Corps Gazette, 
XLVI11 (November, 1964), p. 6, which states in part: ‘''Following 
the breakup of a recent officers' selection board, a general 
officer was overheard to say 'Now | can go back to my regular 
duties with a clear cut idea on how to mark officers' fitness 
BePORUS. 
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3. Board of Evaluation 

A board of evaluation concept should be developed and 
tested. The committee concept discussed at length in Chapter 
V surely has much to offer the much-maligned, single-rater 
system. 

The relevant information which could be Sassembled con- 
cerning the performance of the individual would be far greater 
than that which is now assembled. 

To be sure, the details for the board of evaluation's 
Operation would need long and serious study. And, with the 
inception of board evaluation, reporting may become more time- 
consuming---for the board members, not the reporting officer. 
Yet, mindful of the inherent responsibility of the Marine Corps 
to achieve perfect comparison of contemporary Marines, it is to 
be suggested that implementation of this conclusion would result 
in another ''giant-step'' toward that goal while using the present 
reporting vehicle at no-risk to current standards of reporting, 
evaluation, or comparison. 

4. Standard Scoring ° 

Existing records establish without doubt that some reporting 
seniors constantly mark higher than others, that some groups have 
a higher average of marks than others, and that the ''average'' 
mark varies from period to period. If marks were to be compared 
only within a particular group or during a particular time period 
these differences would be of little concern. But promotion 
boards are confronted with the task of selecting the ''best quali- 
fied'' using, as an indication of merit, fitness reports Seen 


by numerous reporting seniors and over a considerable period of 
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time. Direct comparison of scores awarded in such a manner is 
not meaningful. To expect a promotion board to mentally com- 
pensate for the several varying factors is unreasonable and un- 
necessary, when studied judgements concerning these idiosyn- 
crasies can be applied with consistency to raw scores during 
computation of the standard scores. 

Conversion of raw fitness report marks to standard scores 
allows direct comparison of one report with another, removing 
from board members the anguish of guessing at the value of fit- 
ness report marks prepared under varying conditions. 

5. EDP 

Certain facets of a Marine's record will probably never be 
so well understood that they can be quantified, but those matters 
that can be quantified, should be quantified. In producing a 
better starting point for the promotion board, the computer can 
significantly reduce the number of unscientific evaluations of 
miniscule details associated with the review of fitness reports. 

The computer can be committed against evaluation weakness 
immediately in some matters, not so soon in others. Current 
applications would include these, at least: 

a. Numerical evaluation of fitness reports. 

b. Standard scoring of reports. 

c. Evaluation of entire records. 

d. Preparation of marker feedback information. 
Later, at least these would be added commitments: 

a. Determination of marker validity. 

b. Determination of report reliability and validity. 


c. Determination of reliability of report items. 
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6. Rating Scale 


The cues on the rating scale, which now range from ''un- 
satisfactory'’ to ''outstanding,'' should be changed to more use- 
ful ones. Probably no one can assess the damage which the 
persistent use of the current cues has caused. 

It is to be admitted that the concern of Marine Corps 
officer appraisal is not whether the middle-man is called 
"average’' or ''above average’! or ''exceilent,'' and some may 
say let 'well-enough' alone. 

To be sure, the vital concern of Marine Corps officer 
appraisal is not to provide labels; it is to achieve correct 
comparison of one individua! with another. But the evidence, 
some of which has been discussed in this study, is undeniably 
in favor of the thought that the cues of the current rating 
scale are inviting interpretations and judgments in such a way 
that the vital goal of approprdate comparison is not being 
achieved. !t must certainly be valid to suspect that ‘well- 
enough! is not good enough. 

This paper makes no pretense to have made exhaustive study 
of rating scales .¢ We are, however, compelled to remark in 
passing that a prime concern in revamping the cues and the scale 
should be a concern for compatibility of the scale to ''optical 


3 


scanning'' in association with EDP. 


zFor an interesting study of rating scales in Marine Corps 
terms, see: Colonel Grant S. Baze, ''A Rating Scale for Marine 
Non-Commissioned Officers of the First Three Pay Grades,'' (An 
Unpublished Thesis, Chio State University, 1947). 


Jone possibility is the adaptation of the form to be used 
with the International Business Machine 1231 or 1232 Cptical Mark 
Page Reader. For full discussion, see: {PM publication A-21-9012-1, 
"1BM 1231, 1232 Optical Mark Page Reader,'' (Rochester, Minnesota: 
1963). 92 
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Although the current cues may have caused unassessable 
damage, the objections to their change in the past have had 
merit. Basically, those objections have centered about the 
concern for making comparisons of reports across rating scales. 
The merit of the objections came indirectly from the obvious 
practical impossibility of standard scoring all reports. Now, 
the computer has destroyed the merit of that objection. 

7. Scoring Budget 

It may be valid to suggest that the previous conclusions, 
if implemented, will adequately cope with the weaknesses of 
the reporting system which we have chosen to investigate. 
There is, however, one thought to be planted here for possible 
future consideration. | 

This thought would require no investigation unless there 
would persist a tendency toward inflated ratings and Jack of 
discrimination. In the event investigation was| necessary, it 
is noted that there may be some merit to installation of a 
system which would ''budget'' the total evaluation that a marking 
Organization could use. 

If, for example, a command had 100 officers of one rank, 
and if the mid-point numerical evaluation of the scale (new 
or current) were prescribed to be 85, then the total evaluation 
for the fitness reports to be submitted by the command might be 
limited to 8,500 (85 x 100). Such a technique would force a 
distribution and would tend to cause more perceptive evaluation 


and a better comparison of officers. 
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But this is a thought to be considered during another day 
when escalated effort to overcome continuing personnel evaluation 
problems might be required. 

A Final Statement 

To implement the conclusions of this study would possibly be 
costly in terms of human effort required for their execution. 

The equipment which may be required seems already to be available. 

But, whatever the cost, is it worth the price? Should we be 
so concerned for personnel evaluation? 

Halsey answers those questions as well as anyone. He writes: 

All this (personnel evaluation) takes much time and 

thought and continuous and conscientious attention 

to every detail. But accurate evaluation and analysis 

of the job performance of each person in the organi- 

zation, executive and employee alike, is the only 

correct starting point for almost every phase of 

personnel administration...And a careful, conscientious 

program of employee merit rating---one which includes 

and gives proper weights to all evidence, both 


objective and subjective---is still the best method 
of obtaining this evaluation and analysis...A good 


e 


job of merit rating is worth whatever it costs. 


Even so, it may seem that some of these conclusions are 
almost too unusual, maybe uncommon. But stop for a moment, if 
you will, to consider their role. Their intent is to evaluate 
the Marine Corps officer. He is, most frequently, an unusual 


man; his, is an uncommon organization. 


4ceorge D. Halsey, Handbook of Personnel Management, 
(New York: Harper and Brothers, 1953), p. 242. 
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APPENDIX A 
COMPUTER PROGRAMS 
Programs 

The computer programs included as part of this study are 
presented primarily to illustrate the simplicity of adequate 
programs and the speed with which the computer can accomplish 
the type of arithmetic required for computation of means, 
Standard deviations and standardized scores. 

Two programs are included. Yhe first one, called MEAN, 
computes the means and standard deviations of the raw scores 
awarded in each rank by individual reporting officers, and the 
over-all means and averages for each rank throughout the Marine 
Corps. The second program, STAND, converts raw fitness report 
scores to standardized scores. 

With each program is included a description of its purpose, 
inputs not included in the section entitled |!nputs to the Com- 
puter, a brief description of the program computations, a 
Fortran 63 listing of the program, a sample output, a flow dia- 
gram of the program and the time required to execute the program. 

The times listed for each program are precise only for the 
particular program and equipment involved. Times for similar 
Operations may be reduced by more efficient programming and faster 
equipment or may be increased by more ambitious outputs and less 


agile computers. 


control Data Corporation, Fortran 63/Reference Manual, 


June, 1964. 
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The Computer 


The primary equipment used was the Control Data Corporation 


1604 computer located at the Computer: Facility, U. S. Naval; Post- 


graduate School, Monterey, California. 


Definitions of Variables 


The variables used and inputs required are, in a large part, 


common to both programs and so are defined in the next two 


sections rather than with each program. 


Variable 


FRE 


GDAV (L) 


GDAVE(L) 


GDDV (L) 


GDDEV(L) 


Definition 
Frequency of Observation (See Section B, 15A, 


of Figure 4, page 17) 


Weight Frequency of Observation 
3 Daily Contact 
2 Frequent Observation 


l Infrequent Observation 
Mean value of raw marks assigned to wt trait 
for a particular rank throughout the Marine 
Corps during the period considered. 
Mean value of raw marks assigned to pth trait 
for a particular rank by a single marking 
officer during the period considered. 
Standard deviation of the raw marks assigned to 
the L™" trait for a particular rank throughout 
the Marine Corps during the period considered. 
Standard deviation of raw marks assigned to the 
Lth trait for a particular mark by a single 


marking officer during the period considered. 
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Variable 


IND 


MO 


NMO 


RANK 


RPO 


SER 


YR 


Definition 


Identifies the type of data card being read, i.e. 


O - End of data cards for a particular reporting 
officer 


1 - Raw fitness report marks 

2 - Standardized report marks 

9 - End of data deck 

Month the fitness report was completed (Section 
AS, Figure 4) 

Duration of fitness report in months (Section 
Poa el GuUBeL a) 

Digit representing pay grade of the reportee 
(Section Al, Figure 4) 


Digit Pay Grade Digit Pay Grade 


| 0-1 6 0-6 
2 0-2 / 0-7 
3 0-3 8 0-8 
4 0-4 9 0-9 
2 are 


Service number of the reporting officer. 
Service number of the reportee. 
Year (last two digits) fitness report was 


completed (Section A5, Figure 4) 


Inputs to the Computer 


Information from fitness reports is read into the computer 


on 80-column |BM punched cards. Data for one fitness report are 


transcribed to a punched card in the format shown below. 
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Card Column 


2 

Sige 
6-11 
12-13 
14-15 
16-17 
18-23 
24 

25 
26-69 
28-29 
30-69 
70-80 


Variable 


IND 


RANK 


BLANK 


SER 


MO 


YR 


NMO 


RPO 


BLANK 


FRE 


| 


GD(L) L 


2 


GD(L) L 
GD(L) L= 3, 22 


BLANK 


Data cards must be in groups by reporting officer. Each 


such group is in order by the rank of the reportee. 


A data card with a'zero! in column one must follow the batch 


of fitness reports completed by each marking officer. 


A data card with a'nine! punched in column one must follow the 


last fitness report data card. 


Program MEAN 


This program computes the means and standard deviations of 


the raw scores assigned to each of the twenty-two traits on the 


fitness report. 


The means and standard deviations are computed 


and output by rank of reportee for each marking officer and for 


the entire Marine Corps. 


Computations reflect the weights assigned 
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to the varying duration and frequency of observation. The manner 


in which weights are assigned is explained in a subsequent para- 


graph headed Computation. 
[Input 


The input for this program is the raw fitness report data on 
punched cards as described in the two preceding sections. 
Computation 

The duration of the report in months, NMO, is multiplied 
by the frequency of observation, FRE, to form the variable W. 

W is the weight assigned to the report. WS(L), the sum of the 
weights assigned to the pth trait, allows consideration of ''not 
observed'' marks within a report as suggested on page 2]. 

W(K,L) is the sum of all the Ws for the KtA bank (of reportee) 
and Lt) trait assigned by an radiate reporting officer, i.e., | 
mark for trait one (L) assigned to majors (K) by a particular 
reporting officer. 

Weights can be varied by changing the values assigned to NMO 
and FRE (see statement 3 in Figure 25, page 112). If no weighting 
is desired a value of one should be assigned to each. 

The means and standard deviations are computed using the 
relationships described on page 60. 

The means and standard deviations of each trait for each 
rank (of reportee) are output for each reporting officer prior to 
computing the marks for subsequent reporting officers. The weighted 
marks of all reports are accumulated through the individual com- 
putations and finally output as the Marine Corps-wide means and 
Standard deviations for each trait and rank of reportee. 


See Figure 25, page 111, for a Fortran 632 listing of this program. 
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Computer Output 


The outputs from this program are the means and standard 
deviations of each of the twenty-two traits on the current 
Marine Corps Officer fitness report, computed for each reportee 
rank (Warrant Officer, W-1, through Lieutenant Colonel). The 
means and standard deviations are printed to two decimal places 
and are organized to reflect individual reporting officer's 
results as well as the Marine Corps-wide results. 

Figure 2h, page109, is a sample output of a portion of a 
reporting officer's efforts. 

Figure 24, page]10, is a sample output of over-all Marine 
Corps means and standard deviations. 

Five hundred fictitious fitness reports were processed by 
this program in OR€ minute and twenty-three seconds. 

Figure 26, page]14, is the flow chart for this program. 
Program STAND 

This program converts the raw fitness report scores to 
Standardized scores. Each of the twenty-two traits on the fitness 
report is individually converted, then consolidated with the 
Standardized scores of the other traits and output with identi- 
fying information (serial number of reportee and reporting 
officer, date completed, duration of observation, etc.) to form 
the full standardized report. 

Input 

The inputs to this program are the raw fitness report data 

On punched cards as described on pages 102 and 103 


and the Marine Corps-wide means and standard deviations of each 
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trait for each rank of reportee--the output from program MEAN, 
Input data cards are read in the following order: 


First card with means of raw scores (see below for card 
format) 


Second card with means of raw scores. 

First card with standard deviations of raw scores. 
Second card with standard deviations of raw Scores. 
Raw fitness reports. 

There should be no blank cards or other separators between 
raw fitness report data cards. A card with a ’zero! punched in 
column one must follow the last raw fitness report card. 

Data card format for the Marine Corps-wide mean of the raw 


scores Of each trait and rank of reportee is: 


Card Column Variable 
IND 
2 RANK 
6-9 GDAV (1) 
10-13 GDAV (2) 
46-49 GDAV (11) 


Second Card 


IND 
2 RANK 

6-9 GDAV (12) 
10-13 GDAV (13) 
46-49 GDDV (11) 
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Data card format for Marine Corps-wide standard deviations 


of raw scores for each trait for each rank of reportee is: 


Card Column 


l 
2 
6-9 


10-13 


46-49 


6-9 


10-13 


46-49 


Computation 


Second Card 


Variable 


IND 


GDDV (2) 


GDDV(11) 


IND 
RANK 
GDDV (12) 


GDDV (13) 


GDDV (22) 


The Marine Corps-wide means and standard deviations of the 


raw scores are combined with the raw scores of individual fitness 


reports to compute a # score as shown below and in Figure 28, 


page 118, 


ra 


GDDV 


GD(L) - GDAV(L) 
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The Z score is then multiplied by the arbitrarily chosen 
Standard deviation of the standard score (10) and added to the 
arbitrarily chosen mean (70) of the standard score to compute 
the standardized score for each trait and each fitness report 
as shown below and in Figure 28, page 118. 

Standardized score = /0 + 10* 2 

The mean and standard deviation of the standard scale can 
be modified at will by providing the desired values in statement 
3000 of Figure 28, page 118. 

The standardized score for a trait is output prior to com- 
putation of the standard score for the following trait. 
Computer Output 

The output from this program is a standardized fitness 
report for each raw report input. 

The standardized report includes the serial number and 
rank of reportee, the serial number of the reporting officer, 
the month and year the report was completed, the duration of 
the report, the frequency of observation and, of course, 
Standardized scores for each of the twenty-two traits of the 
fitness report. 

Figure 27 is a sample output for this program. 

Five hundred fictiitious fitness reports were standardized 
by this program in two minutes.and fourteen seconds. 


Flow Diagram 


The flow diagram for this program is shown in Figure 29 
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98 
300 
842 
99 


100: 
1111 
1112 
1113 


843 
B44 
Lt 
700 

91 


92 


1a 
12 


14 
15 


iz 
18 


20 
21 


25 


PROGRAM MEAN 

TYPE REAL NMO 

DIMENSION GDAVE (22) »GDDEV(22) »GD( 22) »WS(22) 
DIMENSION GDS(22) sGDSS (22) sGDAV( 22) sGDDV( 22) 
DIMENSTON GDSA(9922) »sGDSSA(9922) »sWSA(9922) 

DO 98 K=199 

DO 98 K=1s22 

GDSA(KsL)=06 

GDSSA(KsL)=000 

WSA(KsL)=0020 ve 
CONTINUE S 
RAN=0.0 ; 

x=060 

DO 100 U=ls22 

GDS(L)=060 , 

GDSS(L)=06 

CONTINUE 

PRINT 1112 

FORMAT(1H1////) 


FORMAT (/5Xs5HTRAIT 9X s4HMEAN911X97HSTD DEV) 
‘READ 1s INDs RANK sSERsMO sYReNMOsRPOsFRE 9 (GD(L) sL=1 922) 


FORMAT(I19FleOs3XsF6e093F2e09F6e0s1XsFleOs22F200) 
IF (RANK e£Q 2020) 8435844 
IF (RANeEQe020) 5593 

IF (RANK eEQeRAN) 8009777 
IF (XeEQe020)700593 
PRINT 91 

FORMAT (//39Xs36HMEAN AND STANDARD.DEVIATION OF MARKS) 
PRINT 92s9RPO 

FORMAT(18Xs12HAWARDED BY O>5F6.0) 

RAN=RANK $ K=RANK 

GO TO (1191491759203235265 295 32935)K 

PRINT 12 | 

FORMAT (//920Xs19HWARRANT OFFICER W- 1/) 

PRINT 1113 

GO TO 800. 

PRINT 15 

BORE (12 Op 7A eee OFFICERsW-2/) 

PRINT 1113 

GO TO 800 

PRINT 18 

FORMAT (//s20X919HWARRANT OFFICER »W-3/) 

PRINT 1113 

GO TO 800 

PRINT 21. 

FORMAT (//5920X 9 1OHWARRANT ‘OFFICER sW-G/) 

PRINT 1113 | 
GO TO 800 

PRINT 24 


od 


Fortran 63 Listing of Program MEAN 


Figure 25 





24 


26 
7a 4 


29 
30 


52 
23 


oye, 
36 


a7 O01 


93 


942 


2) 
94 


943 
285 
801 
920 
_ 1000 
LU 


FORMAT (//920X917HSECOND LIEUTENANT/)- 
PRINT 1113 

GO TO 800 

PRINT, 27 

FORMAT (//920X916HFIRST LIEUTENANT/) 
BRING 

GO TO 800 

PRINT 30 

FORMAT (//922X97HCAPTAIN/) 

PRINT 1113 

GO TO 800 

PRINT 33 

FORMAT (//923X95HMAJOR/ ) 

PRINT 1113 

GO TO 800 

PRINT 36 

FORMATU// 5 20X»18HLTEUTENANT COLONEL/) 
PRINT 1113 

Oy le=ie22 

TEGD. ese O< Osan ae 

W=NMO*FRE 

WS(L)=W+WS(L) 


“WSA(KoL)=WSA(KoL) +W 


SGD=GD(L)*¥*2 

GDS(L)=GDS(L)+W*GD(L) 
GDSS(L)=GDSS(L)+W*SGD 

GDSA(Ko9L) =GDSA(KoL)+W*GD(L) 
GDSSA(K9L)=GDSSA(K9L)+W*SGD 

CONT INUE : 
X=X+1e0 i 
GO TO 5 

DO 94 N=1l 922 

DO 942 L=ls22 

GDAVE(L)=GDS(L)/WS(L) 
SQR=WS(L)*GDSS(L)-GDS(L)**2 
GDDEV(L)=(1e/WS(L))*SQRTF(SQR) 
PRINT 959NeGDAVE(N) sGDDEVI(N). 
FORMAT(7XeIT299XoF6e 2910X9F be 2) 
CONTINUE 

X=020 

DO 943 L=ls22 
WS(L)=0-20 
GDSS(L)=0-0 

IF (INDeEQe0) 3009801 
IF CINDeEQe9) 10009920 
X=0-e-0 $ GO TO 700 
PRINT 1199 
FORMAT(LHI/S/S//////7/7) 
PRINT 1001 


Figure 25 (continued) 
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HOC) 


O02 


61 
i 


62 
toe 


63 
73 
64 
74 


65 
75 


66 
16 


67 
hk 


68 
18 


69 
19 


Zit 


Zi 


— 


Zi2 


hoo 9: 


2000 


FORMAT(//916Xs17HMARINE CORPS WIDE ) 
PRINT 1002 

FORMAT(/4Xs41HMEAN AND STANDARD DEVIATION 
DO 1999 K=1599 

GO TO, (61962963564 965366967368 969)K 
PRINT. 71 

FORMAT(//520Xs19HWARRANT OFFICERsW-1/) 
PRINT 1113 

GO TO 211 

PRINT 72 

FORMAT(//920X919HWARRANT OFFICER»W-2/) 
PRINT 1113 

GO TO 211 

PRINT 73 

FORMAT(//920X919HWARRANT OFFICER»W-3/) 
PRINT 1113 , 

GO TO 211 

PRINT 74 

FORMAT (//920Xs19HWARRANT OFFICER; W-4/) 
PRINT 1113 

GO TO 211 

PRINT 75 

FORMAT (//920Xs1L7HSECOND LIEUTENANT/Z) 
PRINT 1113 

GOmie 2 11 

PRINT 76 

FORMAT (//920Xs 16HFIRST LIEUTENANT/ ) 
PRINT 1113 : : 


GO TO 211 


PRINT 77 . ey 


“FORMAT (//922X9 7HCAPTAIN/) 


PRINT 1113 

GO TO 211 

PRINT 78 

FORMAT(//523Xs5 SHMAJOR? } 

PRINT 1113 : 

GO TO 211 

PRINT 79 

FORMAT (//920Xs18HLIEUTENANT COLONEL/ ) 
PRINT 1113 

DO 2120 l=ls22 
GNAV(L)=GNSA(K9L) /WSA(K 9L) 

SQ=WSA(KsL) ¥GDSSA(KsL) ~-GDSA(K5L) ¥¥2 
GDDV(L)=(1e/WSA(KsL) )*SQRTF (SQ) 
CONTINUE 

DO 213 L=1s22 an 


PRINT 959LsGDAV(L) sGDDV(L) 


CONTINUE 
CONTINUE 
END . 


Figure 25 (continued) 
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OF RAW SCORES) 





START }————————————- 
(stat ) GDSA(K,L)=0 | 


GDSSA(K,L)=0 
WSA(K,L)=0 
K=1,9, L=1,22 


383] ) > 
00 


D> 


READ DATA 
CARDS 


t 


RANK=0? aie , >» Bib 


yes 


ax; 


es 


> ; 
177 9h; | 


GDAVE(L)=GDS (L) /ws (L) 

SQR=WS (L)*GDSS (!.) -GDS (L) #2 
GDDEV (L)=(1/wWS (L) )*SQRTF(SQR) 
L=1,22 










PRINT 
GDAVE(L) 
GDDEV (L) 
2 






Se 


Flow Diagram for Program MEAN 
Figure 26 
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Figure 26 (continued) 
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GDS (L)=0 
WS(L)=0 

GDSS (L)=0 
b= 122 







~ 





an — 


GDAV(L)=GDSA(K,L)/WSA(K,L) _ 
| S0-WSA(K, L)*GDSSA(K,L) -GDSA(K,L) #2 
GDDV(L)=(1/WS (K,L) }*SQRTF (SQ) 
L=1,22 














PRINT 
L, GDAV(L) 
GDDV(L) 

L=1,22 







2000 
LAST RANK? 





END 


Figure 26 (continued) 
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Figure 27 
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PROGRAM STAND 
DIMENSION GDAV(9522) sGDDV(9922) »GD(22) 
TYPE REAL NMO»sMO | 


C READ IN GRADE AVE (GDAV) AND STO DEV (GDDV) 


2 
1 


203 


1 


14 


FORMAT(11s4X911F4e2) 

FORMAT (1194Xs11F4e2) 

PRINT 203 

FORMAT(2H1 +) 

DO 14 K=199 

READ 2sINDs (GDAV(KsL) sL=1911) 
READ 29INDs (GDAV(KsL) sL=12s22) 
READ 11sINDs(GDDV(KsL) sL=1511) 
READ 1ls INDs(GDDV(Kos5L) sL=12922) . 
CONTINUE 


C READ IN GRADES FROM ONE FITNESS REPORT 


3 
4 


3000 


202 
200 


201 


READ GsINDsRANK sSERsMOsYResNMOsRPO,SFRE 9 (GD(L) »sLEl922) 
FORMATCI19FleO093XsF6e0 o3F2eO0sF6e0slXsFleDOs22F2e00) 
L=1] 

K=RANK 

Z=(GD(L)-GDAV(KsL))/GDDV(K»L) 

J=L+1 

Y=(GD(J)-GDAV(KsJ) )/GDDV(K »L) | | 
GD(L)=704+10.*Z 

GD(J)=700e+10e* Y 

L=tL +2 

IF (LeGTe22) 20095 . 
FORMAT(////) . 
PRINT 202 

PRINT 201 

FORMAT (///910Xs31HSTANDARDIZED SCORES ASSIGNED TO ) 
PRINT 8sSER»sMOsYR 


8 FORMAT(8X»s8HOFFICER »F6e091X917HFOR PERIOD ENDING,» 


9 


2 


1B 
10 


2000 
2001 
1000 


LF2e¢Os1H/ sF20e091lHe ) 


PRINT 9s9FREsNMO 
FORMAT( 1Xs25HFREQUENCY OF OBSERVATION »sFleOolHe 2X» 


LI6HMONTHS OBSERVED »F2e0slHe) 


PRINT 12 
FORMAT(//95Xs21HTRAIT STANDARD SCORE 94X¢9 


L21HTRAIT STANDARD SCORE ) 


DO 10 L=ls21s2 

J=L+1 

PRINT 13sLsGD(L)sJsGD(J) 

FORMAT (7X9IT2910X9F5e299XsIT29 IX9F5e2) 
CONTINUE 

GO TO 3 

PRINT 2001 

FORMAT( 6Xs °23H ERROR WRONG DATA DECK _ ) 
END 


Fortran 63 Listing of Program STAND 


Figure 28 
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PRINT HEADING 


[READ GDAV(K,L),GDDV(K,L) 
alee any 






FREAD DATA CARD | 


PRINT STANDARDIZED REPORT 


Flow Diagram for Pregront, STAND 


Figure 29 
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